Nov 08 13:39:16 user nova-compute[87365]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=87365) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=87365) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=87365) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 13:39:16 user nova-compute[87365]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:39:16 user nova-compute[87365]: INFO nova.virt.driver [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 13:39:16 user nova-compute[87365]: INFO nova.compute.provider_config [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Acquiring lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Acquired lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Releasing lock "singleton_lock" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Full set of CONF: {{(pid=87365) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ******************************************************************************** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Configuration options gathered from: {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ================================================================================ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] allow_resize_to_same_host      = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] arq_binding_timeout            = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] backdoor_port                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] backdoor_socket                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] block_device_allocate_retries  = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] block_device_allocate_retries_interval = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cert                           = self.pem {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute_monitors               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] config_dir                     = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] config_drive_format            = iso9660 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] config_source                  = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] console_host                   = user {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] control_exchange               = nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cpu_allocation_ratio           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] daemon                         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] debug                          = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_access_ip_network_name = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_availability_zone      = nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_ephemeral_format       = ext4 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_green_pool_size        = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] default_schedule_zone          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] disk_allocation_ratio          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] enable_new_services            = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] enabled_apis                   = ['osapi_compute'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] enabled_ssl_apis               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] flat_injected                  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] force_config_drive             = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] force_raw_images               = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] graceful_shutdown_timeout      = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] heal_instance_info_cache_interval = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] host                           = user {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_build_timeout         = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_delete_interval       = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_name_template         = instance-%08x {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_usage_audit           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_usage_audit_period    = month {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] internal_service_availability_zone = internal {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] key                            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] live_migration_retry_count     = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_config_append              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_dir                        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_file                       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_options                    = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_rotate_interval            = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_rotate_interval_type       = days {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] log_rotation_type              = none {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] long_rpc_timeout               = 1800 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_concurrent_builds          = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_concurrent_live_migrations = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_concurrent_snapshots       = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_local_block_devices        = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_logfile_count              = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] max_logfile_size_mb            = 200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] maximum_instance_delete_attempts = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metadata_listen                = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metadata_listen_port           = 8775 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metadata_workers               = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] migrate_max_retries            = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] mkisofs_cmd                    = genisoimage {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] my_ip                          = 10.0.0.210 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] network_allocate_retries       = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] osapi_compute_listen_port      = 8774 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] osapi_compute_unique_server_name_scope =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] osapi_compute_workers          = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] password_length                = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] periodic_enable                = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] periodic_fuzzy_delay           = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] pointer_model                  = ps2mouse {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] preallocate_images             = none {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] publish_errors                 = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] pybasedir                      = /opt/stack/nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ram_allocation_ratio           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rate_limit_burst               = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rate_limit_except_level        = CRITICAL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rate_limit_interval            = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reboot_timeout                 = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reclaim_instance_interval      = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] record                         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reimage_timeout_per_gb         = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] report_interval                = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rescue_timeout                 = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reserved_host_cpus             = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reserved_host_disk_mb          = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reserved_host_memory_mb        = 512 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] reserved_huge_pages            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] resize_confirm_window          = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] resize_fs_using_block_device   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] resume_guests_state_on_host_boot = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rpc_response_timeout           = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] run_external_periodic_tasks    = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] running_deleted_instance_action = reap {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] running_deleted_instance_poll_interval = 1800 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] running_deleted_instance_timeout = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler_instance_sync_interval = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_down_time              = 720 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] servicegroup_driver            = db {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] shelved_offload_time           = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] shelved_poll_interval          = 3600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] shutdown_timeout               = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] source_is_ipv6                 = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ssl_only                       = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] state_path                     = /opt/stack/data/nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] sync_power_state_interval      = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] sync_power_state_pool_size     = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] syslog_log_facility            = LOG_USER {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] tempdir                        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] timeout_nbd                    = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] transport_url                  = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] update_resources_interval      = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_cow_images                 = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_eventlog                   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_journal                    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_json                       = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_rootwrap_daemon            = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_stderr                     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] use_syslog                     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vcpu_pin_set                   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plugging_is_fatal          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plugging_timeout           = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] virt_mkfs                      = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] volume_usage_poll_interval     = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] watch_log_file                 = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] web                            = /usr/share/spice-html5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_concurrency.disable_process_locking = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.auth_strategy              = keystone {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.compute_link_prefix        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.dhcp_domain                = novalocal {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.enable_instance_password   = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.glance_link_prefix         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.instance_list_per_project_cells = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.list_records_by_skipping_down_cells = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.local_metadata_per_cell    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.max_limit                  = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.metadata_cache_expiration  = 15 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.neutron_default_tenant_id  = default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.use_forwarded_for          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.use_neutron_default_nets   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_dynamic_targets = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_jsonfile_path   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.backend                  = dogpile.cache.memcached {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.backend_argument         = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.config_prefix            = cache.oslo {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.dead_timeout             = 60.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.debug_cache_backend      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.enable_retry_client      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.enable_socket_keepalive  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.enabled                  = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.expiration_time          = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.hashclient_retry_attempts = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_dead_retry      = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_password        =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_sasl_enabled    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.memcache_username        =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.proxies                  = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.retry_attempts           = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.retry_delay              = 0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.socket_keepalive_count   = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.socket_keepalive_idle    = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.socket_keepalive_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.tls_allowed_ciphers      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.tls_cafile               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.tls_certfile             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.tls_enabled              = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cache.tls_keyfile              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.auth_section            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.auth_type               = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.cafile                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.certfile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.collect_timing          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.cross_az_attach         = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.debug                   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.endpoint_template       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.http_retries            = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.insecure                = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.keyfile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.os_region_name          = RegionOne {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.split_loggers           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cinder.timeout                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.cpu_dedicated_set      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.cpu_shared_set         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.image_type_exclude_list = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.max_concurrent_disk_ops = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.max_disk_devices_to_attach = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.resource_provider_association_refresh = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.shutdown_retry_interval = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] conductor.workers              = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] console.allowed_origins        = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] console.ssl_ciphers            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] console.ssl_minimum_version    = default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] consoleauth.token_ttl          = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.cafile                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.certfile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.collect_timing          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.connect_retries         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.connect_retry_delay     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.endpoint_override       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.insecure                = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.keyfile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.max_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.min_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.region_name             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.service_name            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.service_type            = accelerator {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.split_loggers           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.status_code_retries     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.timeout                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] cyborg.version                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.backend               = sqlalchemy {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.connection            = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.connection_debug      = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.connection_parameters =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.connection_recycle_time = 3600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.connection_trace      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.db_inc_retry_interval = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.db_max_retries        = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.db_max_retry_interval = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.db_retry_interval     = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.max_overflow          = 50 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.max_pool_size         = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.max_retries           = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.mysql_wsrep_sync_wait = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.pool_timeout          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.retry_interval        = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.slave_connection      = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] database.sqlite_synchronous    = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.backend           = sqlalchemy {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.connection        = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.connection_debug  = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.connection_parameters =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.connection_recycle_time = 3600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.connection_trace  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.db_inc_retry_interval = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.db_max_retries    = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.db_max_retry_interval = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.db_retry_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.max_overflow      = 50 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.max_pool_size     = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.max_retries       = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.pool_timeout      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.retry_interval    = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.slave_connection  = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] api_database.sqlite_synchronous = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] devices.enabled_mdev_types     = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ephemeral_storage_encryption.enabled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.api_servers             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.cafile                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.certfile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.collect_timing          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.connect_retries         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.connect_retry_delay     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.debug                   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.default_trusted_certificate_ids = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.enable_certificate_validation = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.enable_rbd_download     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.endpoint_override       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.insecure                = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.keyfile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.max_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.min_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.num_retries             = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.rbd_ceph_conf           =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.rbd_connect_timeout     = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.rbd_pool                =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.rbd_user                =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.region_name             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.service_name            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:16 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.service_type            = image {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.split_loggers           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.status_code_retries     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.timeout                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.verify_glance_signatures = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] glance.version                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] guestfs.debug                  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.config_drive_cdrom      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.config_drive_inject_password = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.enable_instance_metrics_collection = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.enable_remotefx         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.instances_path_share    =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.iscsi_initiator_list    = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.limit_cpu_features      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.power_state_check_timeframe = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.use_multipath_io        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.volume_attach_retry_count = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.vswitch_name            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] mks.enabled                    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.manager_interval   = 2400 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.precache_concurrency = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.remove_unused_base_images = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] image_cache.subdirectory_name  = _base {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.api_max_retries         = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.api_retry_interval      = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.auth_section            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.auth_type               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.cafile                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.certfile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.collect_timing          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.conductor_group         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.connect_retries         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.connect_retry_delay     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.endpoint_override       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.insecure                = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.keyfile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.max_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.min_version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.peer_list               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.region_name             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.serial_console_state_timeout = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.service_name            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.service_type            = baremetal {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.split_loggers           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.status_code_retries     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.timeout                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ironic.version                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] key_manager.fixed_key          = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.barbican_api_version  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.barbican_endpoint     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.barbican_endpoint_type = public {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.barbican_region_name  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.cafile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.certfile              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.collect_timing        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.insecure              = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.keyfile               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.number_of_retries     = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.retry_delay           = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.send_service_user_token = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.split_loggers         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.timeout               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.verify_ssl            = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican.verify_ssl_path       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.auth_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.cafile   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.keyfile  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] barbican_service_user.timeout  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.approle_role_id          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.approle_secret_id        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.cafile                   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.certfile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.collect_timing           = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.insecure                 = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.keyfile                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.kv_mountpoint            = secret {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.kv_path                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.kv_version               = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.namespace                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.root_token_id            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.split_loggers            = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.ssl_ca_crt_file          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.timeout                  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.use_ssl                  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.auth_section          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.auth_type             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.cafile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.certfile              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.collect_timing        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.connect_retries       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.connect_retry_delay   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.endpoint_override     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.insecure              = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.keyfile               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.max_version           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.min_version           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.region_name           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.service_name          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.service_type          = identity {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.split_loggers         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.status_code_retries   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.timeout               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] keystone.version               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.connection_uri         =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_mode               = custom {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: WARNING oslo_config.cfg [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_power_governor_high = performance {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_power_governor_low = powersave {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_power_management   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.device_detach_attempts = 8 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.device_detach_timeout  = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.disk_cachemodes        = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.disk_prefix            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.enabled_perf_events    = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.file_backed_memory     = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.gid_maps               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.hw_disk_discard        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.hw_machine_type        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_rbd_glance_store_name =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_rbd_pool        = rbd {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_type            = default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.images_volume_group    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.inject_key             = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.inject_partition       = -2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.inject_password        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.iscsi_iface            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.iser_use_multipath     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_bandwidth = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_downtime = 500 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_inbound_addr = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_permit_post_copy = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_scheme  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_timeout_action = abort {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_tunnelled = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: WARNING oslo_config.cfg [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 13:39:17 user nova-compute[87365]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 13:39:17 user nova-compute[87365]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 13:39:17 user nova-compute[87365]: and ``live_migration_inbound_addr`` respectively.
Nov 08 13:39:17 user nova-compute[87365]: ).  Its value may be silently ignored in the future.
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.live_migration_with_native_tls = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.max_queues             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.nfs_mount_options      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_memory_encrypted_guests = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_pcie_ports         = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.pmem_namespaces        = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.quobyte_client_cfg     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rbd_secret_uuid        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rbd_user               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.remote_filesystem_transport = ssh {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rescue_image_id        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rescue_kernel_id       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rescue_ramdisk_id      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.rx_queue_size          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.smbfs_mount_options    =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.snapshot_compression   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.snapshot_image_format  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.sparse_logical_volumes = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.swtpm_enabled          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.swtpm_group            = tss {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.swtpm_user             = tss {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.sysinfo_serial         = unique {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.tb_cache_size          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.tx_queue_size          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.uid_maps               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.use_virtio_for_bridges = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.virt_type              = kvm {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.volume_clear           = zero {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.volume_clear_size      = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.volume_use_multipath   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_cache_path   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.vzstorage_mount_user   = stack {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.auth_section           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.auth_type              = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.cafile                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.certfile               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.collect_timing         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.connect_retries        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.connect_retry_delay    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.default_floating_pool  = public {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.endpoint_override      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.extension_sync_interval = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.http_retries           = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.insecure               = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.keyfile                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.max_version            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.min_version            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.ovs_bridge             = br-int {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.physnets               = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.region_name            = RegionOne {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.service_metadata_proxy = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.service_name           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.service_type           = network {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.split_loggers          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.status_code_retries    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.timeout                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] neutron.version                = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] notifications.bdms_in_notifications = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] notifications.default_level    = INFO {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] notifications.notification_format = unversioned {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] notifications.notify_on_state_change = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] pci.alias                      = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] pci.device_spec                = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] pci.report_in_placement        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.auth_section         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.auth_type            = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.cafile               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.certfile             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.collect_timing       = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.connect_retries      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.connect_retry_delay  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.default_domain_id    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.default_domain_name  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.domain_id            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.domain_name          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.endpoint_override    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.insecure             = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.keyfile              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.max_version          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.min_version          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.password             = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.project_domain_id    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.project_domain_name  = Default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.project_id           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.project_name         = service {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.region_name          = RegionOne {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.service_name         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.service_type         = placement {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.split_loggers        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.status_code_retries  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.system_scope         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.timeout              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.trust_id             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.user_domain_id       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.user_domain_name     = Default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.user_id              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.username             = placement {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] placement.version              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.cores                    = 20 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.count_usage_from_placement = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.injected_file_content_bytes = 10240 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.injected_file_path_length = 255 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.injected_files           = 5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.instances                = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.key_pairs                = 100 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.metadata_items           = 128 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.ram                      = 51200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.recheck_quota            = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.server_group_members     = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] quota.server_groups            = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rdp.enabled                    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.image_metadata_prefilter = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.max_attempts         = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.max_placement_results = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.query_placement_for_image_type_support = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] scheduler.workers              = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.host_subset_size = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.isolated_hosts = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.isolated_images = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.pci_in_placement = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.track_instance_changes = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metrics.required               = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metrics.weight_multiplier      = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] metrics.weight_setting         = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.enabled         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.port_range      = 10000:20000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] serial_console.serialproxy_port = 6083 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.auth_section      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.auth_type         = password {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.cafile            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.certfile          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.collect_timing    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.insecure          = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.keyfile           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.send_service_user_token = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.split_loggers     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] service_user.timeout           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.agent_enabled            = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.enabled                  = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.html5proxy_port          = 6082 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.image_compression        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.jpeg_compression         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.playback_compression     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.server_listen            = 127.0.0.1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.streaming_mode           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] spice.zlib_compression         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] upgrade_levels.baseapi         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] upgrade_levels.cert            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] upgrade_levels.compute         = auto {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] upgrade_levels.conductor       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] upgrade_levels.scheduler       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.auth_section = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.auth_type = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.cafile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.certfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.insecure = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.keyfile = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vendordata_dynamic_auth.timeout = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.api_retry_count         = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.ca_file                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.cache_prefix            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.cluster_name            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.connection_pool_size    = 10 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.console_delay_seconds   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.datastore_regex         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.host_ip                 = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.host_password           = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.host_port               = 443 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.host_username           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.insecure                = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.integration_bridge      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.maximum_objects         = 100 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.pbm_default_policy      = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.pbm_enabled             = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.pbm_wsdl_location       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.serial_port_proxy_uri   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.serial_port_service_uri = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.task_poll_interval      = 0.5 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.use_linked_clone        = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.vnc_keymap              = en-us {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.vnc_port                = 5900 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vmware.vnc_port_total          = 10000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.auth_schemes               = ['none'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.enabled                    = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.novncproxy_port            = 6080 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.server_listen              = 0.0.0.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.vencrypt_ca_certs          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.vencrypt_client_cert       = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vnc.vencrypt_client_key        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.disable_rootwrap   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.enable_numa_live_migration = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.libvirt_disable_apic = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.client_socket_timeout     = 900 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.default_pool_size         = 1000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.keep_alive                = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.max_header_line           = 16384 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.ssl_ca_file               = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.ssl_cert_file             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.ssl_key_file              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.tcp_keepidle              = 600 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] zvm.ca_file                    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] zvm.cloud_connector_url        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] zvm.reachable_timeout          = 300 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.enforce_new_defaults = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.enforce_scope      = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.policy_default_rule = default {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.connection_string     = messaging:// {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.enabled               = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.es_doc_type           = notification {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.es_scroll_size        = 10000 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.es_scroll_time        = 2m {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.filter_error_trace    = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.hmac_keys             = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.sentinel_service_name = mymaster {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.socket_timeout        = 0.1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.trace_requests        = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler.trace_sqlalchemy      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler_jaeger.process_tags   = {} {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler_jaeger.service_name_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] profiler_otlp.service_name_prefix = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] remote_debug.host              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] remote_debug.port              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_notifications.retry = -1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.auth_section        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.auth_type           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.cafile              = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.certfile            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.collect_timing      = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.connect_retries     = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.connect_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.endpoint_id         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.endpoint_override   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.insecure            = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.keyfile             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.max_version         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.min_version         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.region_name         = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.service_name        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.service_type        = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.split_loggers       = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.status_code_retries = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.status_code_retry_delay = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.timeout             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.valid_interfaces    = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_limit.version             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_reports.file_event_handler = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] oslo_reports.log_dir           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.group  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] vif_plug_ovs_privileged.user   = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.flat_interface = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.isolate_vif         = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_vif_ovs.per_port_bridge     = False {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] os_brick.lock_path             = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.capabilities   = [21] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.group          = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.helper_command = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] privsep_osbrick.user           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.group           = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.helper_command  = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] nova_sys_admin.user            = None {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG oslo_service.service [None req-7f218ff2-e15f-49e8-b615-c89055c0bb74 None None] ******************************************************************************** {{(pid=87365) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 13:39:17 user nova-compute[87365]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Connecting to libvirt: qemu:///system {{(pid=87365) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3d1c4eb010> {{(pid=87365) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 13:39:17 user nova-compute[87365]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 13:39:17 user nova-compute[87365]: WARNING nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3d1c4eb010> {{(pid=87365) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Starting native event thread {{(pid=87365) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Starting green dispatch thread {{(pid=87365) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Starting connection event dispatch thread {{(pid=87365) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 13:39:17 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Connection event '1' reason 'None'
Nov 08 13:39:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 13:39:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.mount [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Initialising _HostMountState generation 0 {{(pid=87365) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 13:39:24 user nova-compute[87365]: INFO nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host capabilities <capabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <host>
Nov 08 13:39:24 user nova-compute[87365]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 13:39:24 user nova-compute[87365]:     <cpu>
Nov 08 13:39:24 user nova-compute[87365]:       <arch>x86_64</arch>
Nov 08 13:39:24 user nova-compute[87365]:       <model>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <microcode version='1070'/>
Nov 08 13:39:24 user nova-compute[87365]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='osxsave'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='invtsc'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='rsba'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 13:39:24 user nova-compute[87365]:       <pages unit='KiB' size='4'/>
Nov 08 13:39:24 user nova-compute[87365]:       <pages unit='KiB' size='2048'/>
Nov 08 13:39:24 user nova-compute[87365]:     </cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <power_management>
Nov 08 13:39:24 user nova-compute[87365]:       <suspend_mem/>
Nov 08 13:39:24 user nova-compute[87365]:       <suspend_disk/>
Nov 08 13:39:24 user nova-compute[87365]:       <suspend_hybrid/>
Nov 08 13:39:24 user nova-compute[87365]:     </power_management>
Nov 08 13:39:24 user nova-compute[87365]:     <iommu support='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <migration_features>
Nov 08 13:39:24 user nova-compute[87365]:       <live/>
Nov 08 13:39:24 user nova-compute[87365]:       <uri_transports>
Nov 08 13:39:24 user nova-compute[87365]:         <uri_transport>tcp</uri_transport>
Nov 08 13:39:24 user nova-compute[87365]:         <uri_transport>rdma</uri_transport>
Nov 08 13:39:24 user nova-compute[87365]:       </uri_transports>
Nov 08 13:39:24 user nova-compute[87365]:     </migration_features>
Nov 08 13:39:24 user nova-compute[87365]:     <topology>
Nov 08 13:39:24 user nova-compute[87365]:       <cells num='2'>
Nov 08 13:39:24 user nova-compute[87365]:         <cell id='0'>
Nov 08 13:39:24 user nova-compute[87365]:           <memory unit='KiB'>8140616</memory>
Nov 08 13:39:24 user nova-compute[87365]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 08 13:39:24 user nova-compute[87365]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 13:39:24 user nova-compute[87365]:           <distances>
Nov 08 13:39:24 user nova-compute[87365]:             <sibling id='0' value='10'/>
Nov 08 13:39:24 user nova-compute[87365]:             <sibling id='1' value='20'/>
Nov 08 13:39:24 user nova-compute[87365]:           </distances>
Nov 08 13:39:24 user nova-compute[87365]:           <cpus num='6'>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 13:39:24 user nova-compute[87365]:           </cpus>
Nov 08 13:39:24 user nova-compute[87365]:         </cell>
Nov 08 13:39:24 user nova-compute[87365]:         <cell id='1'>
Nov 08 13:39:24 user nova-compute[87365]:           <memory unit='KiB'>8255100</memory>
Nov 08 13:39:24 user nova-compute[87365]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 08 13:39:24 user nova-compute[87365]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 13:39:24 user nova-compute[87365]:           <distances>
Nov 08 13:39:24 user nova-compute[87365]:             <sibling id='0' value='20'/>
Nov 08 13:39:24 user nova-compute[87365]:             <sibling id='1' value='10'/>
Nov 08 13:39:24 user nova-compute[87365]:           </distances>
Nov 08 13:39:24 user nova-compute[87365]:           <cpus num='6'>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 13:39:24 user nova-compute[87365]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 13:39:24 user nova-compute[87365]:           </cpus>
Nov 08 13:39:24 user nova-compute[87365]:         </cell>
Nov 08 13:39:24 user nova-compute[87365]:       </cells>
Nov 08 13:39:24 user nova-compute[87365]:     </topology>
Nov 08 13:39:24 user nova-compute[87365]:     <cache>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 13:39:24 user nova-compute[87365]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 13:39:24 user nova-compute[87365]:     </cache>
Nov 08 13:39:24 user nova-compute[87365]:     <secmodel>
Nov 08 13:39:24 user nova-compute[87365]:       <model>apparmor</model>
Nov 08 13:39:24 user nova-compute[87365]:       <doi>0</doi>
Nov 08 13:39:24 user nova-compute[87365]:     </secmodel>
Nov 08 13:39:24 user nova-compute[87365]:     <secmodel>
Nov 08 13:39:24 user nova-compute[87365]:       <model>dac</model>
Nov 08 13:39:24 user nova-compute[87365]:       <doi>0</doi>
Nov 08 13:39:24 user nova-compute[87365]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 13:39:24 user nova-compute[87365]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 13:39:24 user nova-compute[87365]:     </secmodel>
Nov 08 13:39:24 user nova-compute[87365]:   </host>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='alpha'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>clipper</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='armv6l'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>spitz</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>nuri</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>kzm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>z2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>tosa</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n810</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>terrier</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>midway</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>microbit</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>verdex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>highbank</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>akita</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>connex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>collie</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='armv7l'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>spitz</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>nuri</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>kzm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>z2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>tosa</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n810</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>terrier</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>midway</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>microbit</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>verdex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>highbank</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>akita</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>connex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>collie</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='aarch64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>spitz</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>nuri</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>kzm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>z2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>tosa</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n810</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>n800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>terrier</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>midway</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>microbit</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>verdex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>highbank</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>akita</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>connex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>collie</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <acpi default='on' toggle='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='cris'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='i686'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>isapc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>microvm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='kvm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <pae/>
Nov 08 13:39:24 user nova-compute[87365]:       <nonpae/>
Nov 08 13:39:24 user nova-compute[87365]:       <acpi default='on' toggle='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:       <apic default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='m68k'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>an5206</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>q800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='microblaze'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='microblazeel'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='mips'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>malta</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='mipsel'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>malta</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='mips64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>malta</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>pica61</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>magnum</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='mips64el'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>malta</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>pica61</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>magnum</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='16'>boston</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='ppc'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mac99</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>40p</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>taihu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='ppc64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>taihu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>40p</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mac99</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='ppc64le'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>taihu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>40p</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>mac99</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='riscv32'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='8'>spike</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='8'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='riscv64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='8'>spike</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='8'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='s390x'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='sh4'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>shix</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>r2d</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='sh4eb'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>shix</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>r2d</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='sparc'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>LX</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='sparc64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>niagara</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='x86_64'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>64</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='1'>isapc</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>microvm</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='kvm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <acpi default='on' toggle='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:       <apic default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='xtensa'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>sim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>kc705</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ml605</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx200</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx60</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]:   <guest>
Nov 08 13:39:24 user nova-compute[87365]:     <os_type>hvm</os_type>
Nov 08 13:39:24 user nova-compute[87365]:     <arch name='xtensaeb'>
Nov 08 13:39:24 user nova-compute[87365]:       <wordsize>32</wordsize>
Nov 08 13:39:24 user nova-compute[87365]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='4'>sim</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>kc705</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ml605</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>virt</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx200</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>lx60</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 13:39:24 user nova-compute[87365]:       <domain type='qemu'/>
Nov 08 13:39:24 user nova-compute[87365]:     </arch>
Nov 08 13:39:24 user nova-compute[87365]:     <features>
Nov 08 13:39:24 user nova-compute[87365]:       <cpuselection/>
Nov 08 13:39:24 user nova-compute[87365]:       <deviceboot/>
Nov 08 13:39:24 user nova-compute[87365]:       <disksnapshot default='on' toggle='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     </features>
Nov 08 13:39:24 user nova-compute[87365]:   </guest>
Nov 08 13:39:24 user nova-compute[87365]: </capabilities>
Nov 08 13:39:24 user nova-compute[87365]: 
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for cris via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-q35-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>i686</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='288'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'/>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='lm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-i440fx-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>i686</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='255'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'/>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='lm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ide</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-i440fx-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>i686</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='255'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'/>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='lm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ide</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-q35-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>i686</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='288'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'/>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='lm'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for mips via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-q35-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>x86_64</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='288'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>efi</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='invtsc'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='rsba'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-i440fx-jammy</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>x86_64</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='255'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>efi</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='invtsc'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='rsba'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ide</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-i440fx-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>x86_64</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='255'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>efi</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='invtsc'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='rsba'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ide</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 13:39:24 user nova-compute[87365]: <domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 13:39:24 user nova-compute[87365]:   <domain>kvm</domain>
Nov 08 13:39:24 user nova-compute[87365]:   <machine>pc-q35-6.2</machine>
Nov 08 13:39:24 user nova-compute[87365]:   <arch>x86_64</arch>
Nov 08 13:39:24 user nova-compute[87365]:   <vcpu max='288'/>
Nov 08 13:39:24 user nova-compute[87365]:   <iothreads supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:   <os supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='firmware'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>efi</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:     <loader supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>rom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pflash</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='readonly'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='secure'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>yes</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>no</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </loader>
Nov 08 13:39:24 user nova-compute[87365]:   </os>
Nov 08 13:39:24 user nova-compute[87365]:   <cpu>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-passthrough' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='hostPassthroughMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='maximum' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='maximumMigratable'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>on</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>off</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='host-model' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <vendor>Intel</vendor>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ss'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='vmx'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pcid'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='hypervisor'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arat'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='umip'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='md-clear'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='invtsc'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibpb'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='ibrs'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-stibp'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='rsba'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='erms'/>
Nov 08 13:39:24 user nova-compute[87365]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:     <mode name='custom' supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>qemu64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>qemu32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>phenom</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>pentium</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>n270</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm64</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>kvm32</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>coreduo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>core2duo</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>athlon</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Westmere</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Snowridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Skylake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>SandyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Penryn</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G5</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G4</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G3</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Opteron_G2</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Opteron_G1</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>IvyBridge</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Icelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Haswell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Rome</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-Milan</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>EPYC</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Dhyana</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cooperlake</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>Conroe</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='no'>Broadwell</model>
Nov 08 13:39:24 user nova-compute[87365]:       <model usable='yes'>486</model>
Nov 08 13:39:24 user nova-compute[87365]:     </mode>
Nov 08 13:39:24 user nova-compute[87365]:   </cpu>
Nov 08 13:39:24 user nova-compute[87365]:   <memoryBacking supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:     <enum name='sourceType'>
Nov 08 13:39:24 user nova-compute[87365]:       <value>file</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>anonymous</value>
Nov 08 13:39:24 user nova-compute[87365]:       <value>memfd</value>
Nov 08 13:39:24 user nova-compute[87365]:     </enum>
Nov 08 13:39:24 user nova-compute[87365]:   </memoryBacking>
Nov 08 13:39:24 user nova-compute[87365]:   <devices>
Nov 08 13:39:24 user nova-compute[87365]:     <disk supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='diskDevice'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>disk</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cdrom</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>floppy</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>lun</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='bus'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>fdc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sata</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </disk>
Nov 08 13:39:24 user nova-compute[87365]:     <graphics supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='type'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>sdl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vnc</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>spice</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egl-headless</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </graphics>
Nov 08 13:39:24 user nova-compute[87365]:     <video supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='modelType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>cirrus</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>vmvga</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>qxl</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>none</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>bochs</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>ramfb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </video>
Nov 08 13:39:24 user nova-compute[87365]:     <hostdev supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='mode'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>subsystem</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='startupPolicy'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>default</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>mandatory</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>requisite</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>optional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='subsysType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>usb</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>pci</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>scsi</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='capsType'/>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='pciBackend'/>
Nov 08 13:39:24 user nova-compute[87365]:     </hostdev>
Nov 08 13:39:24 user nova-compute[87365]:     <rng supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtio-non-transitional</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>random</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>egd</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>builtin</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </rng>
Nov 08 13:39:24 user nova-compute[87365]:     <filesystem supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='driverType'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>path</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>handle</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>virtiofs</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </filesystem>
Nov 08 13:39:24 user nova-compute[87365]:     <tpm supported='yes'>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='model'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-tis</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>tpm-crb</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:       <enum name='backendModel'>
Nov 08 13:39:24 user nova-compute[87365]:         <value>passthrough</value>
Nov 08 13:39:24 user nova-compute[87365]:         <value>emulator</value>
Nov 08 13:39:24 user nova-compute[87365]:       </enum>
Nov 08 13:39:24 user nova-compute[87365]:     </tpm>
Nov 08 13:39:24 user nova-compute[87365]:   </devices>
Nov 08 13:39:24 user nova-compute[87365]:   <features>
Nov 08 13:39:24 user nova-compute[87365]:     <gic supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:     <vmcoreinfo supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <genid supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backingStoreInput supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <backup supported='yes'/>
Nov 08 13:39:24 user nova-compute[87365]:     <sev supported='no'/>
Nov 08 13:39:24 user nova-compute[87365]:   </features>
Nov 08 13:39:24 user nova-compute[87365]: </domainCapabilities>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=87365) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=87365) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Checking secure boot support for host arch (x86_64) {{(pid=87365) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 13:39:24 user nova-compute[87365]: INFO nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Secure Boot support detected
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] cpu compare xml: <cpu match="exact">
Nov 08 13:39:24 user nova-compute[87365]:   <model>Nehalem</model>
Nov 08 13:39:24 user nova-compute[87365]: </cpu>
Nov 08 13:39:24 user nova-compute[87365]:  {{(pid=87365) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 13:39:24 user nova-compute[87365]: INFO nova.virt.node [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Generated node identity 3e23700a-4955-415f-80cb-af3ae211a65e
Nov 08 13:39:24 user nova-compute[87365]: INFO nova.virt.node [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Wrote node identity 3e23700a-4955-415f-80cb-af3ae211a65e to /opt/stack/data/nova/compute_id
Nov 08 13:39:24 user nova-compute[87365]: WARNING nova.compute.manager [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Compute nodes ['3e23700a-4955-415f-80cb-af3ae211a65e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 13:39:24 user nova-compute[87365]: INFO nova.compute.manager [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 13:39:24 user nova-compute[87365]: WARNING nova.compute.manager [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 13:39:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:39:24 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:39:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:39:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Hypervisor/Node resource view: name=user free_ram=10823MB free_disk=25.51616668701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:39:25 user nova-compute[87365]: WARNING nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] No compute node record for user:3e23700a-4955-415f-80cb-af3ae211a65e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3e23700a-4955-415f-80cb-af3ae211a65e could not be found.
Nov 08 13:39:25 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Compute node record created for user:user with uuid: 3e23700a-4955-415f-80cb-af3ae211a65e
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:39:25 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] [req-f983c040-9faa-4bd2-863b-f540cf2be888] Created resource provider record via placement API for resource provider with UUID 3e23700a-4955-415f-80cb-af3ae211a65e and name user.
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=87365) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 13:39:25 user nova-compute[87365]: INFO nova.virt.libvirt.host [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] kernel doesn't support AMD SEV
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Libvirt baseline CPU <cpu>
Nov 08 13:39:25 user nova-compute[87365]:   <arch>x86_64</arch>
Nov 08 13:39:25 user nova-compute[87365]:   <model>Nehalem</model>
Nov 08 13:39:25 user nova-compute[87365]:   <vendor>Intel</vendor>
Nov 08 13:39:25 user nova-compute[87365]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 13:39:25 user nova-compute[87365]: </cpu>
Nov 08 13:39:25 user nova-compute[87365]:  {{(pid=87365) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Updated inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Updating resource provider 3e23700a-4955-415f-80cb-af3ae211a65e generation from 0 to 1 during operation: update_inventory {{(pid=87365) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Updating resource provider 3e23700a-4955-415f-80cb-af3ae211a65e generation from 1 to 2 during operation: update_traits {{(pid=87365) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.service [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Creating RPC server for service compute {{(pid=87365) start /opt/stack/nova/nova/service.py:182}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.service [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] Join ServiceGroup membership for this service compute {{(pid=87365) start /opt/stack/nova/nova/service.py:199}}
Nov 08 13:39:25 user nova-compute[87365]: DEBUG nova.servicegroup.drivers.db [None req-dc62551a-dbc6-4d9f-b82c-d32f45d658ab None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=87365) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 13:40:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:40:16 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:40:16 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:40:16 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=10259MB free_disk=25.420032501220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:40:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:40:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:41:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:41:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:41:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:41:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=10181MB free_disk=25.484092712402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:41:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:41:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:42:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:42:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:42:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=10184MB free_disk=25.236827850341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:42:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:42:19 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:42:19 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:42:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:42:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:42:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:43:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:43:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:18 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=9492MB free_disk=25.264942169189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:43:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:43:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:43:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:29 user nova-compute[87365]: INFO nova.compute.claims [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Claim successful on node user
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.037s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:29 user nova-compute[87365]: INFO nova.compute.claims [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Claim successful on node user
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Creating image(s)
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.234s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:30 user nova-compute[87365]: INFO nova.compute.claims [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Claim successful on node user
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.policy [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74300a84ce074dd38166c961d57071cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddd66e9d6104a2c8e71279551cb6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.policy [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99bfb420b98c45d9b13589c4b2153fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f67a8efbc924527972b7f3a4fdac0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.part --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.virt.images [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] 46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.part /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Creating image(s)
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.389s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.compute.claims [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Claim successful on node user
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.part /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.converted" returned: 0 in 0.263s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.166s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa1vblhe0/privsep.sock']
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.450s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Creating image(s)
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "/opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "/opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "/opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user sudo[96627]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa1vblhe0/privsep.sock
Nov 08 13:43:31 user sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.policy [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e066454e9ac4ba29ba82dbd75cf81ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6c54187f6d4f278fc577a31b0ca9af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.040s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.compute.claims [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Claim successful on node user
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Creating image(s)
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "/opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "/opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "/opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.policy [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8fc23eee9e94d759b90e2b9308d1d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9ea00630e945f9864ee305176c45c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Creating image(s)
Nov 08 13:43:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.policy [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74300a84ce074dd38166c961d57071cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddd66e9d6104a2c8e71279551cb6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Successfully created port: 886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:32 user sudo[96627]: pam_unix(sudo:session): session closed for user root
Nov 08 13:43:32 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Spawned new privsep daemon via rootwrap
Nov 08 13:43:32 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 13:43:32 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 13:43:32 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 13:43:32 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96632
Nov 08 13:43:32 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] privsep daemon already running
Nov 08 13:43:32 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] privsep daemon already running
Nov 08 13:43:32 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] privsep daemon already running
Nov 08 13:43:32 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] privsep daemon already running
Nov 08 13:43:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Successfully created port: fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk 1073741824" returned: 0 in 0.047s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.208s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.148s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk 1073741824" returned: 0 in 0.042s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.458s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Cannot resize image /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Ensure instance console log exists: /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Successfully created port: 84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk 1073741824" returned: 0 in 0.040s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.671s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Cannot resize image /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Ensure instance console log exists: /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Successfully created port: e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.168s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.164s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk 1073741824" returned: 0 in 0.050s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.894s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Cannot resize image /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Ensure instance console log exists: /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.166s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk 1073741824" returned: 0 in 0.055s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Cannot resize image /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Ensure instance console log exists: /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.158s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Cannot resize image /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Ensure instance console log exists: /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Successfully created port: 60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Successfully updated port: fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-changed-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Refreshing instance network info cache due to event network-changed-fc315d33-8442-42b3-8efd-61482b1fab32. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:36 user nova-compute[87365]: INFO nova.compute.claims [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Claim successful on node user
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Successfully updated port: 886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Successfully updated port: 84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquired lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance network_info: |[{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Refreshing network info cache for port fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start _get_guest_xml network_info=[{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:36 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:36 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2093578167',display_name='tempest-ServerRescueNegativeTestJSON-server-2093578167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2093578167',id=1,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-cyoj7o71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:30Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=02327cf5-f6ca-41c9-983c-f74508ef6b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.objects.instance [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'pci_devices' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:36 user nova-compute[87365]:   <uuid>02327cf5-f6ca-41c9-983c-f74508ef6b46</uuid>
Nov 08 13:43:36 user nova-compute[87365]:   <name>instance-00000001</name>
Nov 08 13:43:36 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:36 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:36 user nova-compute[87365]:   <metadata>
Nov 08 13:43:36 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:36 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2093578167</nova:name>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:36</nova:creationTime>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:36 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:36 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:user uuid="74300a84ce074dd38166c961d57071cd">tempest-ServerRescueNegativeTestJSON-954030017-project-member</nova:user>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:project uuid="4ddd66e9d6104a2c8e71279551cb6b4d">tempest-ServerRescueNegativeTestJSON-954030017</nova:project>
Nov 08 13:43:36 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:36 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:36 user nova-compute[87365]:         <nova:port uuid="fc315d33-8442-42b3-8efd-61482b1fab32">
Nov 08 13:43:36 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 13:43:36 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:36 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:36 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:36 user nova-compute[87365]:   </metadata>
Nov 08 13:43:36 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:36 user nova-compute[87365]:     <system>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="serial">02327cf5-f6ca-41c9-983c-f74508ef6b46</entry>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="uuid">02327cf5-f6ca-41c9-983c-f74508ef6b46</entry>
Nov 08 13:43:36 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:36 user nova-compute[87365]:     </system>
Nov 08 13:43:36 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:36 user nova-compute[87365]:   <os>
Nov 08 13:43:36 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:36 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:36 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:36 user nova-compute[87365]:   </os>
Nov 08 13:43:36 user nova-compute[87365]:   <features>
Nov 08 13:43:36 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:36 user nova-compute[87365]:     <apic/>
Nov 08 13:43:36 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:36 user nova-compute[87365]:   </features>
Nov 08 13:43:36 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:36 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:36 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:36 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:36 user nova-compute[87365]:   </clock>
Nov 08 13:43:36 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:36 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:36 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:36 user nova-compute[87365]:   </cpu>
Nov 08 13:43:36 user nova-compute[87365]:   <devices>
Nov 08 13:43:36 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:36 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:36 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk"/>
Nov 08 13:43:36 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:36 user nova-compute[87365]:     </disk>
Nov 08 13:43:36 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:36 user nova-compute[87365]:       <mac address="fa:16:3e:a0:93:c6"/>
Nov 08 13:43:36 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:36 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:36 user nova-compute[87365]:       <target dev="tapfc315d33-84"/>
Nov 08 13:43:36 user nova-compute[87365]:     </interface>
Nov 08 13:43:36 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:36 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/console.log" append="off"/>
Nov 08 13:43:36 user nova-compute[87365]:     </serial>
Nov 08 13:43:36 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:36 user nova-compute[87365]:     <video>
Nov 08 13:43:36 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:36 user nova-compute[87365]:     </video>
Nov 08 13:43:36 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:36 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:36 user nova-compute[87365]:     </rng>
Nov 08 13:43:36 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:36 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:36 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:36 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:36 user nova-compute[87365]:   </devices>
Nov 08 13:43:36 user nova-compute[87365]: </domain>
Nov 08 13:43:36 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2093578167',display_name='tempest-ServerRescueNegativeTestJSON-server-2093578167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2093578167',id=1,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-cyoj7o71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:30Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=02327cf5-f6ca-41c9-983c-f74508ef6b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG os_vif [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-changed-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Refreshing instance network info cache due to event network-changed-886761b5-d79a-4e9e-8882-6c456a289b97. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] Acquiring lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Created schema index Interface.name {{(pid=87365) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Created schema index Port.name {{(pid=87365) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Created schema index Bridge.name {{(pid=87365) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [POLLOUT] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.policy [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33521b67405a405f912d0879b3d77829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a890ce53c34008a7a872f409fe4550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Creating image(s)
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "/opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "/opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "/opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ace836f1-cd68-59fc-9fb9-cfb30fbd64e5', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:36 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpz_m33w8b/privsep.sock']
Nov 08 13:43:36 user sudo[96717]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpz_m33w8b/privsep.sock
Nov 08 13:43:36 user sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-changed-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Refreshing instance network info cache due to event network-changed-84b7a7a6-d8f3-4665-93d0-8db1086acf88. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] Acquiring lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk 1073741824" returned: 0 in 0.042s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Successfully updated port: e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquired lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Cannot resize image /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Ensure instance console log exists: /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Updating instance_info_cache with network_info: [{"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Releasing lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Instance network_info: |[{"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] Acquired lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Refreshing network info cache for port 84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Start _get_guest_xml network_info=[{"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1686156355',display_name='tempest-DeleteServersTestJSON-server-1686156355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1686156355',id=3,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6c54187f6d4f278fc577a31b0ca9af',ramdisk_id='',reservation_id='r-jhtoljsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1670689215',owner_user_name='tempest-DeleteServersTestJSON-1670689215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:31Z,user_data=None,user_id='0e066454e9ac4ba29ba82dbd75cf81ef',uuid=e76e8a31-d8a3-4053-8a20-53fcccaacd82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converting VIF {"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lazy-loading 'pci_devices' on Instance uuid e76e8a31-d8a3-4053-8a20-53fcccaacd82 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:38 user nova-compute[87365]:   <uuid>e76e8a31-d8a3-4053-8a20-53fcccaacd82</uuid>
Nov 08 13:43:38 user nova-compute[87365]:   <name>instance-00000003</name>
Nov 08 13:43:38 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:38 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:38 user nova-compute[87365]:   <metadata>
Nov 08 13:43:38 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:38 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:name>tempest-DeleteServersTestJSON-server-1686156355</nova:name>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:37</nova:creationTime>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:38 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:user uuid="0e066454e9ac4ba29ba82dbd75cf81ef">tempest-DeleteServersTestJSON-1670689215-project-member</nova:user>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:project uuid="6d6c54187f6d4f278fc577a31b0ca9af">tempest-DeleteServersTestJSON-1670689215</nova:project>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:port uuid="84b7a7a6-d8f3-4665-93d0-8db1086acf88">
Nov 08 13:43:38 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 13:43:38 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:38 user nova-compute[87365]:   </metadata>
Nov 08 13:43:38 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:38 user nova-compute[87365]:     <system>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="serial">e76e8a31-d8a3-4053-8a20-53fcccaacd82</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="uuid">e76e8a31-d8a3-4053-8a20-53fcccaacd82</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:38 user nova-compute[87365]:     </system>
Nov 08 13:43:38 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:38 user nova-compute[87365]:   <os>
Nov 08 13:43:38 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:38 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:38 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:38 user nova-compute[87365]:   </os>
Nov 08 13:43:38 user nova-compute[87365]:   <features>
Nov 08 13:43:38 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:38 user nova-compute[87365]:     <apic/>
Nov 08 13:43:38 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:38 user nova-compute[87365]:   </features>
Nov 08 13:43:38 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:38 user nova-compute[87365]:   </clock>
Nov 08 13:43:38 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:38 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:38 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:38 user nova-compute[87365]:   </cpu>
Nov 08 13:43:38 user nova-compute[87365]:   <devices>
Nov 08 13:43:38 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:38 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:38 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </disk>
Nov 08 13:43:38 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:38 user nova-compute[87365]:       <mac address="fa:16:3e:5b:a0:a3"/>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="tap84b7a7a6-d8"/>
Nov 08 13:43:38 user nova-compute[87365]:     </interface>
Nov 08 13:43:38 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:38 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/console.log" append="off"/>
Nov 08 13:43:38 user nova-compute[87365]:     </serial>
Nov 08 13:43:38 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:     <video>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </video>
Nov 08 13:43:38 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:38 user nova-compute[87365]:     </rng>
Nov 08 13:43:38 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:38 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:38 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:38 user nova-compute[87365]:   </devices>
Nov 08 13:43:38 user nova-compute[87365]: </domain>
Nov 08 13:43:38 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1686156355',display_name='tempest-DeleteServersTestJSON-server-1686156355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1686156355',id=3,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d6c54187f6d4f278fc577a31b0ca9af',ramdisk_id='',reservation_id='r-jhtoljsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1670689215',owner_user_name='tempest-DeleteServersTestJSON-1670689215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:31Z,user_data=None,user_id='0e066454e9ac4ba29ba82dbd75cf81ef',uuid=e76e8a31-d8a3-4053-8a20-53fcccaacd82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converting VIF {"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG os_vif [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Instance network_info: |[{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fdb378a-3ad3-535b-868e-1ab1726947c5', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] Acquired lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Refreshing network info cache for port 886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Start _get_guest_xml network_info=[{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250423349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250423349',id=2,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-3ha8oeqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:31Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=b3bc6678-0f78-4778-9a0d-95e0a7c3e690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid b3bc6678-0f78-4778-9a0d-95e0a7c3e690 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:38 user nova-compute[87365]:   <uuid>b3bc6678-0f78-4778-9a0d-95e0a7c3e690</uuid>
Nov 08 13:43:38 user nova-compute[87365]:   <name>instance-00000002</name>
Nov 08 13:43:38 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:38 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:38 user nova-compute[87365]:   <metadata>
Nov 08 13:43:38 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:38 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1250423349</nova:name>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:38</nova:creationTime>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:38 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:port uuid="886761b5-d79a-4e9e-8882-6c456a289b97">
Nov 08 13:43:38 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 13:43:38 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:38 user nova-compute[87365]:   </metadata>
Nov 08 13:43:38 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:38 user nova-compute[87365]:     <system>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="serial">b3bc6678-0f78-4778-9a0d-95e0a7c3e690</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="uuid">b3bc6678-0f78-4778-9a0d-95e0a7c3e690</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:38 user nova-compute[87365]:     </system>
Nov 08 13:43:38 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:38 user nova-compute[87365]:   <os>
Nov 08 13:43:38 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:38 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:38 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:38 user nova-compute[87365]:   </os>
Nov 08 13:43:38 user nova-compute[87365]:   <features>
Nov 08 13:43:38 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:38 user nova-compute[87365]:     <apic/>
Nov 08 13:43:38 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:38 user nova-compute[87365]:   </features>
Nov 08 13:43:38 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:38 user nova-compute[87365]:   </clock>
Nov 08 13:43:38 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:38 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:38 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:38 user nova-compute[87365]:   </cpu>
Nov 08 13:43:38 user nova-compute[87365]:   <devices>
Nov 08 13:43:38 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:38 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:38 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </disk>
Nov 08 13:43:38 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:38 user nova-compute[87365]:       <mac address="fa:16:3e:8e:4e:43"/>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="tap886761b5-d7"/>
Nov 08 13:43:38 user nova-compute[87365]:     </interface>
Nov 08 13:43:38 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:38 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/console.log" append="off"/>
Nov 08 13:43:38 user nova-compute[87365]:     </serial>
Nov 08 13:43:38 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:     <video>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </video>
Nov 08 13:43:38 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:38 user nova-compute[87365]:     </rng>
Nov 08 13:43:38 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:38 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:38 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:38 user nova-compute[87365]:   </devices>
Nov 08 13:43:38 user nova-compute[87365]: </domain>
Nov 08 13:43:38 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250423349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250423349',id=2,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-3ha8oeqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:31Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=b3bc6678-0f78-4778-9a0d-95e0a7c3e690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG os_vif [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec4647f3-20e5-569f-8322-0353f8db3bd1', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Successfully updated port: 60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:38 user sudo[96717]: pam_unix(sudo:session): session closed for user root
Nov 08 13:43:38 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Spawned new privsep daemon via rootwrap
Nov 08 13:43:38 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 13:43:38 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 13:43:38 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 13:43:38 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96735
Nov 08 13:43:38 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] privsep daemon already running
Nov 08 13:43:38 user nova-compute[87365]: WARNING oslo_privsep.priv_context [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] privsep daemon already running
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updating instance_info_cache with network_info: [{"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Releasing lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Instance network_info: |[{"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Start _get_guest_xml network_info=[{"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updated VIF entry in instance network info cache for port fc315d33-8442-42b3-8efd-61482b1fab32. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1783992031',display_name='tempest-ServersNegativeTestJSON-server-1783992031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1783992031',id=4,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-j5ae660m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:32Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=78bf22ef-27da-4b43-9da9-37de97525acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lazy-loading 'pci_devices' on Instance uuid 78bf22ef-27da-4b43-9da9-37de97525acc {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab7d2a87-f78b-452c-8efc-46e4d3161d19 req-3ea30dc0-e639-4c76-bf36-d04e777a9863 service nova] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:38 user nova-compute[87365]:   <uuid>78bf22ef-27da-4b43-9da9-37de97525acc</uuid>
Nov 08 13:43:38 user nova-compute[87365]:   <name>instance-00000004</name>
Nov 08 13:43:38 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:38 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:38 user nova-compute[87365]:   <metadata>
Nov 08 13:43:38 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:38 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:name>tempest-ServersNegativeTestJSON-server-1783992031</nova:name>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:38</nova:creationTime>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:38 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:user uuid="e8fc23eee9e94d759b90e2b9308d1d29">tempest-ServersNegativeTestJSON-868089155-project-member</nova:user>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:project uuid="6c9ea00630e945f9864ee305176c45c8">tempest-ServersNegativeTestJSON-868089155</nova:project>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:38 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:         <nova:port uuid="e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58">
Nov 08 13:43:38 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 13:43:38 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:38 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:38 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:38 user nova-compute[87365]:   </metadata>
Nov 08 13:43:38 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:38 user nova-compute[87365]:     <system>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="serial">78bf22ef-27da-4b43-9da9-37de97525acc</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="uuid">78bf22ef-27da-4b43-9da9-37de97525acc</entry>
Nov 08 13:43:38 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:38 user nova-compute[87365]:     </system>
Nov 08 13:43:38 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:38 user nova-compute[87365]:   <os>
Nov 08 13:43:38 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:38 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:38 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:38 user nova-compute[87365]:   </os>
Nov 08 13:43:38 user nova-compute[87365]:   <features>
Nov 08 13:43:38 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:38 user nova-compute[87365]:     <apic/>
Nov 08 13:43:38 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:38 user nova-compute[87365]:   </features>
Nov 08 13:43:38 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:38 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:38 user nova-compute[87365]:   </clock>
Nov 08 13:43:38 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:38 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:38 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:38 user nova-compute[87365]:   </cpu>
Nov 08 13:43:38 user nova-compute[87365]:   <devices>
Nov 08 13:43:38 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:38 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:38 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </disk>
Nov 08 13:43:38 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:38 user nova-compute[87365]:       <mac address="fa:16:3e:4b:0e:20"/>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:38 user nova-compute[87365]:       <target dev="tape7a115f9-b6"/>
Nov 08 13:43:38 user nova-compute[87365]:     </interface>
Nov 08 13:43:38 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:38 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/console.log" append="off"/>
Nov 08 13:43:38 user nova-compute[87365]:     </serial>
Nov 08 13:43:38 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:38 user nova-compute[87365]:     <video>
Nov 08 13:43:38 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:38 user nova-compute[87365]:     </video>
Nov 08 13:43:38 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:38 user nova-compute[87365]:     </rng>
Nov 08 13:43:38 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:38 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:38 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:38 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:38 user nova-compute[87365]:   </devices>
Nov 08 13:43:38 user nova-compute[87365]: </domain>
Nov 08 13:43:38 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1783992031',display_name='tempest-ServersNegativeTestJSON-server-1783992031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1783992031',id=4,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-j5ae660m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:32Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=78bf22ef-27da-4b43-9da9-37de97525acc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG os_vif [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08c0f60d-5ed2-56d2-a6a7-d1fb1e73f542', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-changed-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Refreshing instance network info cache due to event network-changed-60b8cbb7-f771-411b-9de9-effae55c61fe. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] Acquiring lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84b7a7a6-d8, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84b7a7a6-d8, col_values=(('qos', UUID('c8bf1ab5-68b4-46d6-8ba2-12e8bd4e2342')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84b7a7a6-d8, col_values=(('external_ids', {'iface-id': '84b7a7a6-d8f3-4665-93d0-8db1086acf88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:a0:a3', 'vm-uuid': 'e76e8a31-d8a3-4053-8a20-53fcccaacd82'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-changed-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Refreshing instance network info cache due to event network-changed-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] Acquiring lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] Acquired lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Refreshing network info cache for port e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: INFO os_vif [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8')
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc315d33-84, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc315d33-84, col_values=(('qos', UUID('2ddfc839-8fc0-4428-805c-ed080ddf20a4')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc315d33-84, col_values=(('external_ids', {'iface-id': 'fc315d33-8442-42b3-8efd-61482b1fab32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:93:c6', 'vm-uuid': '02327cf5-f6ca-41c9-983c-f74508ef6b46'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: INFO os_vif [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84')
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap886761b5-d7, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap886761b5-d7, col_values=(('qos', UUID('f58cffc5-a45a-47dd-a2d9-807ea8648fcb')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap886761b5-d7, col_values=(('external_ids', {'iface-id': '886761b5-d79a-4e9e-8882-6c456a289b97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:4e:43', 'vm-uuid': 'b3bc6678-0f78-4778-9a0d-95e0a7c3e690'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] No VIF found with MAC fa:16:3e:5b:a0:a3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No VIF found with MAC fa:16:3e:a0:93:c6, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: INFO os_vif [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7')
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7a115f9-b6, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7a115f9-b6, col_values=(('qos', UUID('8a60e7cf-dcb0-4900-aaaf-84a9e4e25684')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7a115f9-b6, col_values=(('external_ids', {'iface-id': 'e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0e:20', 'vm-uuid': '78bf22ef-27da-4b43-9da9-37de97525acc'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: INFO os_vif [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6')
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:8e:4e:43, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] No VIF found with MAC fa:16:3e:4b:0e:20, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance network_info: |[{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] Acquired lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Refreshing network info cache for port 60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start _get_guest_xml network_info=[{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Updated VIF entry in instance network info cache for port 84b7a7a6-d8f3-4665-93d0-8db1086acf88. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Updating instance_info_cache with network_info: [{"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updated VIF entry in instance network info cache for port 886761b5-d79a-4e9e-8882-6c456a289b97. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-987f51b4-e4b1-4363-ac7e-a99ebb60b49a req-aaa63e03-4f3f-42bb-998e-cc7e0b03c7c5 service nova] Releasing lock "refresh_cache-e76e8a31-d8a3-4053-8a20-53fcccaacd82" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-34c6a3d2-a219-4966-93b5-3a9ee7e09972 req-9cfd48a4-e693-4c61-a45f-9525bef6a634 service nova] Releasing lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-421730953',display_name='tempest-ServerRescueNegativeTestJSON-server-421730953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-421730953',id=5,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-0bezjqai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:32Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=8ae2c4a4-aff6-4be8-be12-9e1df495c20e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.objects.instance [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:39 user nova-compute[87365]:   <uuid>8ae2c4a4-aff6-4be8-be12-9e1df495c20e</uuid>
Nov 08 13:43:39 user nova-compute[87365]:   <name>instance-00000005</name>
Nov 08 13:43:39 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:39 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:39 user nova-compute[87365]:   <metadata>
Nov 08 13:43:39 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:39 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-421730953</nova:name>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:39</nova:creationTime>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:39 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:39 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:user uuid="74300a84ce074dd38166c961d57071cd">tempest-ServerRescueNegativeTestJSON-954030017-project-member</nova:user>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:project uuid="4ddd66e9d6104a2c8e71279551cb6b4d">tempest-ServerRescueNegativeTestJSON-954030017</nova:project>
Nov 08 13:43:39 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:39 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:39 user nova-compute[87365]:         <nova:port uuid="60b8cbb7-f771-411b-9de9-effae55c61fe">
Nov 08 13:43:39 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 13:43:39 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:39 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:39 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:39 user nova-compute[87365]:   </metadata>
Nov 08 13:43:39 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:39 user nova-compute[87365]:     <system>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="serial">8ae2c4a4-aff6-4be8-be12-9e1df495c20e</entry>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="uuid">8ae2c4a4-aff6-4be8-be12-9e1df495c20e</entry>
Nov 08 13:43:39 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:39 user nova-compute[87365]:     </system>
Nov 08 13:43:39 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:39 user nova-compute[87365]:   <os>
Nov 08 13:43:39 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:39 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:39 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:39 user nova-compute[87365]:   </os>
Nov 08 13:43:39 user nova-compute[87365]:   <features>
Nov 08 13:43:39 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:39 user nova-compute[87365]:     <apic/>
Nov 08 13:43:39 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:39 user nova-compute[87365]:   </features>
Nov 08 13:43:39 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:39 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:39 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:39 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:39 user nova-compute[87365]:   </clock>
Nov 08 13:43:39 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:39 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:39 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:39 user nova-compute[87365]:   </cpu>
Nov 08 13:43:39 user nova-compute[87365]:   <devices>
Nov 08 13:43:39 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:39 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:39 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk"/>
Nov 08 13:43:39 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:39 user nova-compute[87365]:     </disk>
Nov 08 13:43:39 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:39 user nova-compute[87365]:       <mac address="fa:16:3e:c9:56:f3"/>
Nov 08 13:43:39 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:39 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:39 user nova-compute[87365]:       <target dev="tap60b8cbb7-f7"/>
Nov 08 13:43:39 user nova-compute[87365]:     </interface>
Nov 08 13:43:39 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:39 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/console.log" append="off"/>
Nov 08 13:43:39 user nova-compute[87365]:     </serial>
Nov 08 13:43:39 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:39 user nova-compute[87365]:     <video>
Nov 08 13:43:39 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:39 user nova-compute[87365]:     </video>
Nov 08 13:43:39 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:39 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:39 user nova-compute[87365]:     </rng>
Nov 08 13:43:39 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:39 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:39 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:39 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:39 user nova-compute[87365]:   </devices>
Nov 08 13:43:39 user nova-compute[87365]: </domain>
Nov 08 13:43:39 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-421730953',display_name='tempest-ServerRescueNegativeTestJSON-server-421730953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-421730953',id=5,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-0bezjqai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:32Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=8ae2c4a4-aff6-4be8-be12-9e1df495c20e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG os_vif [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f33b3fb2-d89b-5f60-b740-063704c4ba2f', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Successfully created port: f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60b8cbb7-f7, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60b8cbb7-f7, col_values=(('qos', UUID('08bc2a1f-8ec0-4a30-9bf9-34864b35ab1b')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60b8cbb7-f7, col_values=(('external_ids', {'iface-id': '60b8cbb7-f771-411b-9de9-effae55c61fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:56:f3', 'vm-uuid': '8ae2c4a4-aff6-4be8-be12-9e1df495c20e'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:39 user nova-compute[87365]: INFO os_vif [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7')
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No VIF found with MAC fa:16:3e:c9:56:f3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updated VIF entry in instance network info cache for port e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updating instance_info_cache with network_info: [{"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df6726b-177d-4920-a619-fb9cf237ed70 req-1391e054-777d-457b-8e6d-264c87f72eef service nova] Releasing lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updated VIF entry in instance network info cache for port 60b8cbb7-f771-411b-9de9-effae55c61fe. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42cd22ad-4e48-4397-9843-28f657c50ac6 req-6333e763-0ea3-4f72-ad04-f2e996aae562 service nova] Releasing lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Successfully updated port: f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing instance network info cache due to event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Instance network_info: |[{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG nova.network.neutron [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Start _get_guest_xml network_info=[{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:43 user nova-compute[87365]: DEBUG nova.network.neutron [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated VIF entry in instance network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:43:43 user nova-compute[87365]: DEBUG nova.network.neutron [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2123f699-ce8d-440b-a219-df5b858999e6 req-922827bb-db96-4ab9-b751-1fb287557523 service nova] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.compute.claims [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Claim successful on node user
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Instance spawned successfully.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Instance spawned successfully.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance spawned successfully.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:48 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:48 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1424015704',display_name='tempest-ServerActionsTestOtherA-server-1424015704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1424015704',id=6,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-rp1ronly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=b365675d-bf53-45ad-b7bb-4d89cf1935c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.objects.instance [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'pci_devices' on Instance uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:48 user nova-compute[87365]:   <uuid>b365675d-bf53-45ad-b7bb-4d89cf1935c4</uuid>
Nov 08 13:43:48 user nova-compute[87365]:   <name>instance-00000006</name>
Nov 08 13:43:48 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:48 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:48 user nova-compute[87365]:   <metadata>
Nov 08 13:43:48 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:48 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:name>tempest-ServerActionsTestOtherA-server-1424015704</nova:name>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:48</nova:creationTime>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:48 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:48 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:user uuid="33521b67405a405f912d0879b3d77829">tempest-ServerActionsTestOtherA-777028083-project-member</nova:user>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:project uuid="90a890ce53c34008a7a872f409fe4550">tempest-ServerActionsTestOtherA-777028083</nova:project>
Nov 08 13:43:48 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:48 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:48 user nova-compute[87365]:         <nova:port uuid="f9bd8195-16dc-48da-b0f6-c9980a7ebcaa">
Nov 08 13:43:48 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 13:43:48 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:48 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:48 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:48 user nova-compute[87365]:   </metadata>
Nov 08 13:43:48 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:48 user nova-compute[87365]:     <system>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="serial">b365675d-bf53-45ad-b7bb-4d89cf1935c4</entry>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="uuid">b365675d-bf53-45ad-b7bb-4d89cf1935c4</entry>
Nov 08 13:43:48 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:48 user nova-compute[87365]:     </system>
Nov 08 13:43:48 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:48 user nova-compute[87365]:   <os>
Nov 08 13:43:48 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:48 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:48 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:48 user nova-compute[87365]:   </os>
Nov 08 13:43:48 user nova-compute[87365]:   <features>
Nov 08 13:43:48 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:48 user nova-compute[87365]:     <apic/>
Nov 08 13:43:48 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:48 user nova-compute[87365]:   </features>
Nov 08 13:43:48 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:48 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:48 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:48 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:48 user nova-compute[87365]:   </clock>
Nov 08 13:43:48 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:48 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:48 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:48 user nova-compute[87365]:   </cpu>
Nov 08 13:43:48 user nova-compute[87365]:   <devices>
Nov 08 13:43:48 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:48 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:48 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk"/>
Nov 08 13:43:48 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:48 user nova-compute[87365]:     </disk>
Nov 08 13:43:48 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:48 user nova-compute[87365]:       <mac address="fa:16:3e:4b:b1:04"/>
Nov 08 13:43:48 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:48 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:48 user nova-compute[87365]:       <target dev="tapf9bd8195-16"/>
Nov 08 13:43:48 user nova-compute[87365]:     </interface>
Nov 08 13:43:48 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:48 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/console.log" append="off"/>
Nov 08 13:43:48 user nova-compute[87365]:     </serial>
Nov 08 13:43:48 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:48 user nova-compute[87365]:     <video>
Nov 08 13:43:48 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:48 user nova-compute[87365]:     </video>
Nov 08 13:43:48 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:48 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:48 user nova-compute[87365]:     </rng>
Nov 08 13:43:48 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:48 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:48 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:48 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:48 user nova-compute[87365]:   </devices>
Nov 08 13:43:48 user nova-compute[87365]: </domain>
Nov 08 13:43:48 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1424015704',display_name='tempest-ServerActionsTestOtherA-server-1424015704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1424015704',id=6,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-rp1ronly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=b365675d-bf53-45ad-b7bb-4d89cf1935c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG os_vif [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06e9b920-63d0-556b-87e8-515bccbab476', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9bd8195-16, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9bd8195-16, col_values=(('qos', UUID('72eeb949-07b2-481f-a69a-a42254b8ad01')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9bd8195-16, col_values=(('external_ids', {'iface-id': 'f9bd8195-16dc-48da-b0f6-c9980a7ebcaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:b1:04', 'vm-uuid': 'b365675d-bf53-45ad-b7bb-4d89cf1935c4'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:48 user nova-compute[87365]: INFO os_vif [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16')
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Took 17.82 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Instance spawned successfully.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:48 user nova-compute[87365]: INFO nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Took 17.45 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No VIF found with MAC fa:16:3e:4b:b1:04, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Took 19.24 seconds to build instance.
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Took 18.78 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Took 19.10 seconds to build instance.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-925fe589-88f3-46b5-883e-9692accc616b tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.296s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d637dc41-7494-400f-9691-05982d8e55d1 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.498s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Took 17.28 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Took 20.10 seconds to build instance.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance spawned successfully.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-40ee1f4f-0c75-4a2a-98f2-db6542710baf tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.398s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.884s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Took 19.09 seconds to build instance.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d35b200b-39ff-457b-992e-f009cc9e4164 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.234s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Took 17.19 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:50 user nova-compute[87365]: INFO nova.compute.manager [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Took 18.58 seconds to build instance.
Nov 08 13:43:50 user nova-compute[87365]: DEBUG nova.policy [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7002ccda1ce646f4a0a771982c76d3f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa801fe72a5410fade93d2db86d1f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-87059eb3-0c30-41f9-944c-c1aac6cec07b tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.727s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Creating image(s)
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "/opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "/opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "/opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.388s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.393s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk 1073741824" returned: 0 in 0.133s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.533s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.379s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:51 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:43:51 user nova-compute[87365]: INFO nova.compute.claims [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Claim successful on node user
Nov 08 13:43:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Cannot resize image /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Ensure instance console log exists: /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Successfully created port: 8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.190s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:43:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:43:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Creating image(s)
Nov 08 13:43:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.018s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "397cd06e356683a7955164cdaf86a25503548c95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "397cd06e356683a7955164cdaf86a25503548c95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG nova.policy [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86f57e177fdc404b976e02ea6d975980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b718b33ef834685a4d7bd419c4227d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:43:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Successfully updated port: 8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-changed-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Refreshing instance network info cache due to event network-changed-8fef3506-2f29-4a7c-8092-d327f43f627e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] Acquiring lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] Acquired lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Refreshing network info cache for port 8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.part --force-share --output=json" returned: 0 in 0.370s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.virt.images [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] 69f69d92-9c62-4a5c-b71a-89140a6e7b5f was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.part /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:43:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Instance spawned successfully.
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.part /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.converted" returned: 0 in 0.411s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:55 user nova-compute[87365]: INFO nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Took 18.52 seconds to spawn the instance on the hypervisor.
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.network.neutron [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b460af40-ce93-48d9-908a-61be4cd93b5f req-a4c7b298-8dce-4501-b079-a837f12dece6 service nova] Releasing lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95.converted --force-share --output=json" returned: 0 in 0.478s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquired lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "397cd06e356683a7955164cdaf86a25503548c95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.424s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:55 user nova-compute[87365]: INFO nova.compute.manager [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Took 19.82 seconds to build instance.
Nov 08 13:43:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02cc3e66-7d72-4d83-a8c4-4ba23ee5cc30 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.958s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:55 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json" returned: 0 in 0.367s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "397cd06e356683a7955164cdaf86a25503548c95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "397cd06e356683a7955164cdaf86a25503548c95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json" returned: 0 in 0.329s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95,backing_fmt=raw /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95,backing_fmt=raw /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk 1073741824" returned: 0 in 0.077s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "397cd06e356683a7955164cdaf86a25503548c95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.413s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating instance_info_cache with network_info: [{"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Releasing lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance network_info: |[{"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Start _get_guest_xml network_info=[{"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 --force-share --output=json" returned: 0 in 0.277s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:43:56 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:56 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:43:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-55132472',display_name='tempest-VolumesAdminNegativeTest-server-55132472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-55132472',id=7,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVm8OKlPRcQa5EUpD0IVDjn/UsXkqFle83fH5f0dYFfGy4N9x6mgS67b1qv8o7I4OiRGJPhZyCoEakVE0bROXnrRUF3Bc0QVeltv5bnQja92phhiobbZxSje0PM6jTdRw==',key_name='tempest-keypair-225236727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-ccia4c5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=15d10a18-4260-481d-bdd8-ab3778293278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'pci_devices' on Instance uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:43:57 user nova-compute[87365]:   <uuid>15d10a18-4260-481d-bdd8-ab3778293278</uuid>
Nov 08 13:43:57 user nova-compute[87365]:   <name>instance-00000007</name>
Nov 08 13:43:57 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:43:57 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:43:57 user nova-compute[87365]:   <metadata>
Nov 08 13:43:57 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:43:57 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:name>tempest-VolumesAdminNegativeTest-server-55132472</nova:name>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:43:56</nova:creationTime>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:43:57 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:43:57 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:owner>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:user uuid="7002ccda1ce646f4a0a771982c76d3f1">tempest-VolumesAdminNegativeTest-1087803050-project-member</nova:user>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:project uuid="0fa801fe72a5410fade93d2db86d1f9d">tempest-VolumesAdminNegativeTest-1087803050</nova:project>
Nov 08 13:43:57 user nova-compute[87365]:       </nova:owner>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:43:57 user nova-compute[87365]:       <nova:ports>
Nov 08 13:43:57 user nova-compute[87365]:         <nova:port uuid="8fef3506-2f29-4a7c-8092-d327f43f627e">
Nov 08 13:43:57 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 13:43:57 user nova-compute[87365]:         </nova:port>
Nov 08 13:43:57 user nova-compute[87365]:       </nova:ports>
Nov 08 13:43:57 user nova-compute[87365]:     </nova:instance>
Nov 08 13:43:57 user nova-compute[87365]:   </metadata>
Nov 08 13:43:57 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:43:57 user nova-compute[87365]:     <system>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="serial">15d10a18-4260-481d-bdd8-ab3778293278</entry>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="uuid">15d10a18-4260-481d-bdd8-ab3778293278</entry>
Nov 08 13:43:57 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:43:57 user nova-compute[87365]:     </system>
Nov 08 13:43:57 user nova-compute[87365]:   </sysinfo>
Nov 08 13:43:57 user nova-compute[87365]:   <os>
Nov 08 13:43:57 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:43:57 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:43:57 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:43:57 user nova-compute[87365]:   </os>
Nov 08 13:43:57 user nova-compute[87365]:   <features>
Nov 08 13:43:57 user nova-compute[87365]:     <acpi/>
Nov 08 13:43:57 user nova-compute[87365]:     <apic/>
Nov 08 13:43:57 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:43:57 user nova-compute[87365]:   </features>
Nov 08 13:43:57 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:43:57 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:43:57 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:43:57 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:43:57 user nova-compute[87365]:   </clock>
Nov 08 13:43:57 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:43:57 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:43:57 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:43:57 user nova-compute[87365]:   </cpu>
Nov 08 13:43:57 user nova-compute[87365]:   <devices>
Nov 08 13:43:57 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:43:57 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:43:57 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk"/>
Nov 08 13:43:57 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:43:57 user nova-compute[87365]:     </disk>
Nov 08 13:43:57 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:43:57 user nova-compute[87365]:       <mac address="fa:16:3e:d9:79:98"/>
Nov 08 13:43:57 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:57 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:43:57 user nova-compute[87365]:       <target dev="tap8fef3506-2f"/>
Nov 08 13:43:57 user nova-compute[87365]:     </interface>
Nov 08 13:43:57 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:43:57 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/console.log" append="off"/>
Nov 08 13:43:57 user nova-compute[87365]:     </serial>
Nov 08 13:43:57 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:43:57 user nova-compute[87365]:     <video>
Nov 08 13:43:57 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:43:57 user nova-compute[87365]:     </video>
Nov 08 13:43:57 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:43:57 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:43:57 user nova-compute[87365]:     </rng>
Nov 08 13:43:57 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:43:57 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:43:57 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:43:57 user nova-compute[87365]:     </memballoon>
Nov 08 13:43:57 user nova-compute[87365]:   </devices>
Nov 08 13:43:57 user nova-compute[87365]: </domain>
Nov 08 13:43:57 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-55132472',display_name='tempest-VolumesAdminNegativeTest-server-55132472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-55132472',id=7,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVm8OKlPRcQa5EUpD0IVDjn/UsXkqFle83fH5f0dYFfGy4N9x6mgS67b1qv8o7I4OiRGJPhZyCoEakVE0bROXnrRUF3Bc0QVeltv5bnQja92phhiobbZxSje0PM6jTdRw==',key_name='tempest-keypair-225236727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-ccia4c5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=15d10a18-4260-481d-bdd8-ab3778293278,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG os_vif [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8d49f03-8785-5c30-9425-51f95b9abfc9', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fef3506-2f, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fef3506-2f, col_values=(('qos', UUID('efa43d1a-5386-41cb-85ac-e0f98035c2ec')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fef3506-2f, col_values=(('external_ids', {'iface-id': '8fef3506-2f29-4a7c-8092-d327f43f627e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:79:98', 'vm-uuid': '15d10a18-4260-481d-bdd8-ab3778293278'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Cannot resize image /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Ensure instance console log exists: /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: INFO os_vif [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f')
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No VIF found with MAC fa:16:3e:d9:79:98, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:43:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:43:57 user nova-compute[87365]: WARNING nova.compute.manager [req-c9ba93b5-90e8-4f95-a835-5889de1d2f6c req-7ed9471c-3510-45e9-a6ff-69d621f90ff5 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state None.
Nov 08 13:43:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Successfully created port: ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:43:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:00 user nova-compute[87365]: WARNING nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state None.
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] No waiting events found dispatching network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:00 user nova-compute[87365]: WARNING nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received unexpected event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 for instance with vm_state active and task_state None.
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] No waiting events found dispatching network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:00 user nova-compute[87365]: WARNING nova.compute.manager [req-c2c5e549-faa2-4593-bfc8-ffe48625cd50 req-3e4fe76a-8df5-469b-b5b4-5b9cdf209c96 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received unexpected event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 for instance with vm_state active and task_state None.
Nov 08 13:44:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Successfully updated port: ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquired lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-changed-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Refreshing instance network info cache due to event network-changed-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] Acquiring lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating instance_info_cache with network_info: [{"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Releasing lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Instance network_info: |[{"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] Acquired lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Refreshing network info cache for port ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Start _get_guest_xml network_info=[{"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:43:43Z,direct_url=<?>,disk_format='qcow2',id=69f69d92-9c62-4a5c-b71a-89140a6e7b5f,min_disk=0,min_ram=0,name='',owner='a3a6b22deb054f1498ae36bb37299c20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:43:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'guest_format': None, 'image_id': '69f69d92-9c62-4a5c-b71a-89140a6e7b5f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:44:02 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:02 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:43:43Z,direct_url=<?>,disk_format='qcow2',id=69f69d92-9c62-4a5c-b71a-89140a6e7b5f,min_disk=0,min_ram=0,name='',owner='a3a6b22deb054f1498ae36bb37299c20',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:43:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1542475031',display_name='tempest-AttachSCSIVolumeTestJSON-server-1542475031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1542475031',id=8,image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDLwCMfMEnmdOVE6lFDBRj42EK+qEL9ECL/YcQeSWrwWHa/TeaLW6xbo459Mb03vhQfivHSyh69Bi/13wC4nkchENJtf67IZvKfMk1JDR+DeCQT1J8hQq+pqBLBmgPvw==',key_name='tempest-keypair-38496071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b718b33ef834685a4d7bd419c4227d2',ramdisk_id='',reservation_id='r-v16bxkdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-667266669',owner_user_name='tempest-AttachSCSIVolumeTestJSON-667266669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86f57e177fdc404b976e02ea6d975980',uuid=5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converting VIF {"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:44:02 user nova-compute[87365]:   <uuid>5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b</uuid>
Nov 08 13:44:02 user nova-compute[87365]:   <name>instance-00000008</name>
Nov 08 13:44:02 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:44:02 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:44:02 user nova-compute[87365]:   <metadata>
Nov 08 13:44:02 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:44:02 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1542475031</nova:name>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:44:02</nova:creationTime>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:44:02 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:44:02 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:owner>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:user uuid="86f57e177fdc404b976e02ea6d975980">tempest-AttachSCSIVolumeTestJSON-667266669-project-member</nova:user>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:project uuid="0b718b33ef834685a4d7bd419c4227d2">tempest-AttachSCSIVolumeTestJSON-667266669</nova:project>
Nov 08 13:44:02 user nova-compute[87365]:       </nova:owner>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:root type="image" uuid="69f69d92-9c62-4a5c-b71a-89140a6e7b5f"/>
Nov 08 13:44:02 user nova-compute[87365]:       <nova:ports>
Nov 08 13:44:02 user nova-compute[87365]:         <nova:port uuid="ce489c81-8bbf-45eb-b1bf-1cc7da2a2023">
Nov 08 13:44:02 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 13:44:02 user nova-compute[87365]:         </nova:port>
Nov 08 13:44:02 user nova-compute[87365]:       </nova:ports>
Nov 08 13:44:02 user nova-compute[87365]:     </nova:instance>
Nov 08 13:44:02 user nova-compute[87365]:   </metadata>
Nov 08 13:44:02 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:44:02 user nova-compute[87365]:     <system>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="serial">5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b</entry>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="uuid">5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b</entry>
Nov 08 13:44:02 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:44:02 user nova-compute[87365]:     </system>
Nov 08 13:44:02 user nova-compute[87365]:   </sysinfo>
Nov 08 13:44:02 user nova-compute[87365]:   <os>
Nov 08 13:44:02 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:44:02 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:44:02 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:44:02 user nova-compute[87365]:   </os>
Nov 08 13:44:02 user nova-compute[87365]:   <features>
Nov 08 13:44:02 user nova-compute[87365]:     <acpi/>
Nov 08 13:44:02 user nova-compute[87365]:     <apic/>
Nov 08 13:44:02 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:44:02 user nova-compute[87365]:   </features>
Nov 08 13:44:02 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:44:02 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:44:02 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:44:02 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:44:02 user nova-compute[87365]:   </clock>
Nov 08 13:44:02 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:44:02 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:44:02 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:44:02 user nova-compute[87365]:   </cpu>
Nov 08 13:44:02 user nova-compute[87365]:   <devices>
Nov 08 13:44:02 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:44:02 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:44:02 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk"/>
Nov 08 13:44:02 user nova-compute[87365]:       <target dev="sda" bus="scsi"/>
Nov 08 13:44:02 user nova-compute[87365]:       <address type="drive" controller="0" unit="0"/>
Nov 08 13:44:02 user nova-compute[87365]:     </disk>
Nov 08 13:44:02 user nova-compute[87365]:     <disk type="file" device="cdrom">
Nov 08 13:44:02 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 13:44:02 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.config"/>
Nov 08 13:44:02 user nova-compute[87365]:       <target dev="sdb" bus="scsi"/>
Nov 08 13:44:02 user nova-compute[87365]:       <address type="drive" controller="0" unit="1"/>
Nov 08 13:44:02 user nova-compute[87365]:     </disk>
Nov 08 13:44:02 user nova-compute[87365]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 13:44:02 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:44:02 user nova-compute[87365]:       <mac address="fa:16:3e:68:b1:47"/>
Nov 08 13:44:02 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:02 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:44:02 user nova-compute[87365]:       <target dev="tapce489c81-8b"/>
Nov 08 13:44:02 user nova-compute[87365]:     </interface>
Nov 08 13:44:02 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:44:02 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/console.log" append="off"/>
Nov 08 13:44:02 user nova-compute[87365]:     </serial>
Nov 08 13:44:02 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:44:02 user nova-compute[87365]:     <video>
Nov 08 13:44:02 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:02 user nova-compute[87365]:     </video>
Nov 08 13:44:02 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:44:02 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:44:02 user nova-compute[87365]:     </rng>
Nov 08 13:44:02 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:44:02 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:44:02 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:44:02 user nova-compute[87365]:     </memballoon>
Nov 08 13:44:02 user nova-compute[87365]:   </devices>
Nov 08 13:44:02 user nova-compute[87365]: </domain>
Nov 08 13:44:02 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1542475031',display_name='tempest-AttachSCSIVolumeTestJSON-server-1542475031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1542475031',id=8,image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDLwCMfMEnmdOVE6lFDBRj42EK+qEL9ECL/YcQeSWrwWHa/TeaLW6xbo459Mb03vhQfivHSyh69Bi/13wC4nkchENJtf67IZvKfMk1JDR+DeCQT1J8hQq+pqBLBmgPvw==',key_name='tempest-keypair-38496071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b718b33ef834685a4d7bd419c4227d2',ramdisk_id='',reservation_id='r-v16bxkdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-667266669',owner_user_name='tempest-AttachSCSIVolumeTestJSON-667266669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86f57e177fdc404b976e02ea6d975980',uuid=5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converting VIF {"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG os_vif [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4670f32-2a6f-55e3-9425-59a71b9e2744', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce489c81-8b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce489c81-8b, col_values=(('qos', UUID('10f3ddcc-2a00-4bed-8e22-91db798f530c')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce489c81-8b, col_values=(('external_ids', {'iface-id': 'ce489c81-8bbf-45eb-b1bf-1cc7da2a2023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:b1:47', 'vm-uuid': '5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:02 user nova-compute[87365]: INFO os_vif [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b')
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No BDM found with device name sda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No BDM found with device name sdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No VIF found with MAC fa:16:3e:68:b1:47, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:44:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Using config drive
Nov 08 13:44:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Creating config drive at /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.config
Nov 08 13:44:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprumr8yko {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updated VIF entry in instance network info cache for port ce489c81-8bbf-45eb-b1bf-1cc7da2a2023. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating instance_info_cache with network_info: [{"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprumr8yko" returned: 0 in 0.151s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a7570f62-0267-4f06-a403-60bc812dc049 req-18a0c4a2-a41c-4ceb-8b71-ddfc9864e6c9 service nova] Releasing lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance spawned successfully.
Nov 08 13:44:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:04 user nova-compute[87365]: INFO nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Took 14.25 seconds to spawn the instance on the hypervisor.
Nov 08 13:44:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:44:05 user nova-compute[87365]: INFO nova.compute.manager [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Took 16.51 seconds to build instance.
Nov 08 13:44:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aed9ce1-d49c-4f9a-bf6e-87281c56ea25 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.711s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:44:09 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Instance spawned successfully.
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:09 user nova-compute[87365]: INFO nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Took 16.64 seconds to spawn the instance on the hypervisor.
Nov 08 13:44:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:44:10 user nova-compute[87365]: INFO nova.compute.manager [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Took 18.58 seconds to build instance.
Nov 08 13:44:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d185f634-c932-4ce4-be1f-caf2fc5b9629 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.809s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] No waiting events found dispatching network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:11 user nova-compute[87365]: WARNING nova.compute.manager [req-0cd16212-359e-4d80-9605-aa50ccba6421 req-17faff7b-8b0b-4406-9b65-97601d3aa1fb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received unexpected event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 for instance with vm_state active and task_state None.
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] No waiting events found dispatching network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:11 user nova-compute[87365]: WARNING nova.compute.manager [req-196f2d62-264a-4bca-94c1-bcc8971f4e41 req-f38856a8-54d5-4218-a30f-ef9039240436 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received unexpected event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e for instance with vm_state active and task_state None.
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:11 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:44:11 user nova-compute[87365]: INFO nova.compute.claims [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Claim successful on node user
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:44:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.policy [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '825a92c9a47d4c15a1d5da3996ce27a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e3c8d34ec3d4372af7f40af26722b86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:44:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Creating image(s)
Nov 08 13:44:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "/opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "/opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "/opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.468s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Successfully created port: fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] No waiting events found dispatching network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:13 user nova-compute[87365]: WARNING nova.compute.manager [req-a43af218-1681-42d2-8455-eaed45397df6 req-800daeac-19dc-4c33-b429-b660c40cad78 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received unexpected event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 for instance with vm_state active and task_state None.
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] No waiting events found dispatching network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:13 user nova-compute[87365]: WARNING nova.compute.manager [req-410ddbd0-58aa-46a4-847c-28b222edc4d7 req-2ba2862b-ef64-4a87-9015-fa038e541ddd service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received unexpected event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e for instance with vm_state active and task_state None.
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk 1073741824" returned: 0 in 0.076s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.316s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:44:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Cannot resize image /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Ensure instance console log exists: /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Successfully updated port: fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquired lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updating instance_info_cache with network_info: [{"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Releasing lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Instance network_info: |[{"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Start _get_guest_xml network_info=[{"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:44:14 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:14 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1493447980',display_name='tempest-TestVolumeSwap-server-1493447980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1493447980',id=9,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4MRED/uRLyn4nJ4aByoghW7PPuE7eDOCUMYq5FCHE37GkfKA7ShvZV0JsvscR9KxP+Oom7sxTYDwnT2XL2Hnnx4nDAlNsW1Yz3Nxg3ygEWmmvBiUcmXRfXiFsBoPerfA==',key_name='tempest-keypair-1290437417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e3c8d34ec3d4372af7f40af26722b86',ramdisk_id='',reservation_id='r-qlal25gn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-908946573',owner_user_name='tempest-TestVolumeSwap-908946573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825a92c9a47d4c15a1d5da3996ce27a9',uuid=f33f05cc-e996-4596-bd14-c47e64994f89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converting VIF {"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lazy-loading 'pci_devices' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:44:14 user nova-compute[87365]:   <uuid>f33f05cc-e996-4596-bd14-c47e64994f89</uuid>
Nov 08 13:44:14 user nova-compute[87365]:   <name>instance-00000009</name>
Nov 08 13:44:14 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:44:14 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:44:14 user nova-compute[87365]:   <metadata>
Nov 08 13:44:14 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:44:14 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:name>tempest-TestVolumeSwap-server-1493447980</nova:name>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:44:14</nova:creationTime>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:44:14 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:44:14 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:owner>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:user uuid="825a92c9a47d4c15a1d5da3996ce27a9">tempest-TestVolumeSwap-908946573-project-member</nova:user>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:project uuid="7e3c8d34ec3d4372af7f40af26722b86">tempest-TestVolumeSwap-908946573</nova:project>
Nov 08 13:44:14 user nova-compute[87365]:       </nova:owner>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:44:14 user nova-compute[87365]:       <nova:ports>
Nov 08 13:44:14 user nova-compute[87365]:         <nova:port uuid="fdcefe60-e73a-445e-a6b7-dbe20f600efb">
Nov 08 13:44:14 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:44:14 user nova-compute[87365]:         </nova:port>
Nov 08 13:44:14 user nova-compute[87365]:       </nova:ports>
Nov 08 13:44:14 user nova-compute[87365]:     </nova:instance>
Nov 08 13:44:14 user nova-compute[87365]:   </metadata>
Nov 08 13:44:14 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:44:14 user nova-compute[87365]:     <system>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="serial">f33f05cc-e996-4596-bd14-c47e64994f89</entry>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="uuid">f33f05cc-e996-4596-bd14-c47e64994f89</entry>
Nov 08 13:44:14 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:44:14 user nova-compute[87365]:     </system>
Nov 08 13:44:14 user nova-compute[87365]:   </sysinfo>
Nov 08 13:44:14 user nova-compute[87365]:   <os>
Nov 08 13:44:14 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:44:14 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:44:14 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:44:14 user nova-compute[87365]:   </os>
Nov 08 13:44:14 user nova-compute[87365]:   <features>
Nov 08 13:44:14 user nova-compute[87365]:     <acpi/>
Nov 08 13:44:14 user nova-compute[87365]:     <apic/>
Nov 08 13:44:14 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:44:14 user nova-compute[87365]:   </features>
Nov 08 13:44:14 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:44:14 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:44:14 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:44:14 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:44:14 user nova-compute[87365]:   </clock>
Nov 08 13:44:14 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:44:14 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:44:14 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:44:14 user nova-compute[87365]:   </cpu>
Nov 08 13:44:14 user nova-compute[87365]:   <devices>
Nov 08 13:44:14 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:44:14 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:44:14 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk"/>
Nov 08 13:44:14 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:44:14 user nova-compute[87365]:     </disk>
Nov 08 13:44:14 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:44:14 user nova-compute[87365]:       <mac address="fa:16:3e:77:de:e9"/>
Nov 08 13:44:14 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:14 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:44:14 user nova-compute[87365]:       <target dev="tapfdcefe60-e7"/>
Nov 08 13:44:14 user nova-compute[87365]:     </interface>
Nov 08 13:44:14 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:44:14 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/console.log" append="off"/>
Nov 08 13:44:14 user nova-compute[87365]:     </serial>
Nov 08 13:44:14 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:44:14 user nova-compute[87365]:     <video>
Nov 08 13:44:14 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:14 user nova-compute[87365]:     </video>
Nov 08 13:44:14 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:44:14 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:44:14 user nova-compute[87365]:     </rng>
Nov 08 13:44:14 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:44:14 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:44:14 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:44:14 user nova-compute[87365]:     </memballoon>
Nov 08 13:44:14 user nova-compute[87365]:   </devices>
Nov 08 13:44:14 user nova-compute[87365]: </domain>
Nov 08 13:44:14 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1493447980',display_name='tempest-TestVolumeSwap-server-1493447980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1493447980',id=9,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4MRED/uRLyn4nJ4aByoghW7PPuE7eDOCUMYq5FCHE37GkfKA7ShvZV0JsvscR9KxP+Oom7sxTYDwnT2XL2Hnnx4nDAlNsW1Yz3Nxg3ygEWmmvBiUcmXRfXiFsBoPerfA==',key_name='tempest-keypair-1290437417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e3c8d34ec3d4372af7f40af26722b86',ramdisk_id='',reservation_id='r-qlal25gn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-908946573',owner_user_name='tempest-TestVolumeSwap-908946573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825a92c9a47d4c15a1d5da3996ce27a9',uuid=f33f05cc-e996-4596-bd14-c47e64994f89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converting VIF {"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG os_vif [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f949584-6083-5d83-a663-962161bf6e52', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdcefe60-e7, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdcefe60-e7, col_values=(('qos', UUID('dfb4f07d-ea52-442e-9463-7d0eacb7fb5a')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdcefe60-e7, col_values=(('external_ids', {'iface-id': 'fdcefe60-e73a-445e-a6b7-dbe20f600efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:de:e9', 'vm-uuid': 'f33f05cc-e996-4596-bd14-c47e64994f89'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:15 user nova-compute[87365]: INFO os_vif [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7')
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] No VIF found with MAC fa:16:3e:77:de:e9, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-changed-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Refreshing instance network info cache due to event network-changed-fdcefe60-e73a-445e-a6b7-dbe20f600efb. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] Acquiring lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] Acquired lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.network.neutron [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Refreshing network info cache for port fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.network.neutron [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updated VIF entry in instance network info cache for port fdcefe60-e73a-445e-a6b7-dbe20f600efb. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG nova.network.neutron [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updating instance_info_cache with network_info: [{"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d31e195f-7efc-4c8b-9d05-9e174e390038 req-9e0ca974-f7c5-4146-b04c-02e2c3fd734e service nova] Releasing lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 0 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] No waiting events found dispatching network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:17 user nova-compute[87365]: WARNING nova.compute.manager [req-361cef42-f430-4d84-93cd-6bd319b8c8ee req-82311c41-8d9e-4480-8c10-132fd276ef26 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received unexpected event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb for instance with vm_state building and task_state spawning.
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] No waiting events found dispatching network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:17 user nova-compute[87365]: WARNING nova.compute.manager [req-2cb37095-7ec2-4ba7-ab45-af7aa07496cd req-aaa45490-215a-427e-9647-c097172f18e9 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received unexpected event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 for instance with vm_state active and task_state None.
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] No waiting events found dispatching network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:19 user nova-compute[87365]: WARNING nova.compute.manager [req-57611de5-b599-41a5-b47e-16aaf91f9211 req-be8ad9ab-f4f4-4050-a364-5bade4e017a0 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received unexpected event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb for instance with vm_state building and task_state spawning.
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:44:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Instance spawned successfully.
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:19 user nova-compute[87365]: INFO nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 08 13:44:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:44:19 user nova-compute[87365]: INFO nova.compute.manager [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Took 8.39 seconds to build instance.
Nov 08 13:44:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d2292d81-69ff-48a9-b904-e19446a6da7e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.622s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] No waiting events found dispatching network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received unexpected event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] No waiting events found dispatching network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received unexpected event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] No waiting events found dispatching network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:20 user nova-compute[87365]: WARNING nova.compute.manager [req-e63c5b29-9f1d-4685-aea7-0002e3f3d617 req-e36e4d02-e11a-450b-98e9-b44be87afaf1 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received unexpected event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa for instance with vm_state active and task_state None.
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:20 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "9743709b-872f-4248-bc61-b41122126030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:44:22 user nova-compute[87365]: INFO nova.compute.claims [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Claim successful on node user
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.policy [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ffa552e93fa4d5180f81ac161f516af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b953219fed343b6bf6d0776e1ad43b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:44:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Creating image(s)
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "/opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "/opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "/opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.245s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.241s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Successfully created port: 96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk 1073741824" returned: 0 in 0.052s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Cannot resize image /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Ensure instance console log exists: /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Successfully updated port: 96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-changed-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Refreshing instance network info cache due to event network-changed-96de7723-5a4f-4126-ae3e-1d9ea45ada5b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] Acquiring lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] Acquired lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Refreshing network info cache for port 96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7402MB free_disk=24.951370239257812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a5d3f26-3a22-436a-8d27-7cae1358c0c3 req-93a8d512-e7d8-43b0-9858-93f70ba0c6df service nova] Releasing lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquired lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e76e8a31-d8a3-4053-8a20-53fcccaacd82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9743709b-872f-4248-bc61-b41122126030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Updating instance_info_cache with network_info: [{"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Releasing lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance network_info: |[{"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Start _get_guest_xml network_info=[{"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:44:26 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:26 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-152995279',display_name='tempest-VolumesAssistedSnapshotsTest-server-152995279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-152995279',id=10,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPyPPQ8Z6WvNaatA9jYSz8jpUMSjTUNQ6khirv34KOigulkb7+MF8t/BHPExhKuLcuLXq+IkiGTmGQ1KVhNr6ohmPDSSYfStUoNyQaUJv4Qz7WPEs+JPsv0cljn0DZSog==',key_name='tempest-keypair-1737111603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b953219fed343b6bf6d0776e1ad43b3',ramdisk_id='',reservation_id='r-0c1fx06h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-816186852',owner_user_name='tempest-VolumesAssistedSnapshotsTest-816186852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa552e93fa4d5180f81ac161f516af',uuid=9743709b-872f-4248-bc61-b41122126030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converting VIF {"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.objects.instance [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lazy-loading 'pci_devices' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:44:26 user nova-compute[87365]:   <uuid>9743709b-872f-4248-bc61-b41122126030</uuid>
Nov 08 13:44:26 user nova-compute[87365]:   <name>instance-0000000a</name>
Nov 08 13:44:26 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:44:26 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:44:26 user nova-compute[87365]:   <metadata>
Nov 08 13:44:26 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:44:26 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-152995279</nova:name>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:44:26</nova:creationTime>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:44:26 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:44:26 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:owner>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:user uuid="8ffa552e93fa4d5180f81ac161f516af">tempest-VolumesAssistedSnapshotsTest-816186852-project-member</nova:user>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:project uuid="6b953219fed343b6bf6d0776e1ad43b3">tempest-VolumesAssistedSnapshotsTest-816186852</nova:project>
Nov 08 13:44:26 user nova-compute[87365]:       </nova:owner>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:44:26 user nova-compute[87365]:       <nova:ports>
Nov 08 13:44:26 user nova-compute[87365]:         <nova:port uuid="96de7723-5a4f-4126-ae3e-1d9ea45ada5b">
Nov 08 13:44:26 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:44:26 user nova-compute[87365]:         </nova:port>
Nov 08 13:44:26 user nova-compute[87365]:       </nova:ports>
Nov 08 13:44:26 user nova-compute[87365]:     </nova:instance>
Nov 08 13:44:26 user nova-compute[87365]:   </metadata>
Nov 08 13:44:26 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:44:26 user nova-compute[87365]:     <system>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="serial">9743709b-872f-4248-bc61-b41122126030</entry>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="uuid">9743709b-872f-4248-bc61-b41122126030</entry>
Nov 08 13:44:26 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:44:26 user nova-compute[87365]:     </system>
Nov 08 13:44:26 user nova-compute[87365]:   </sysinfo>
Nov 08 13:44:26 user nova-compute[87365]:   <os>
Nov 08 13:44:26 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:44:26 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:44:26 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:44:26 user nova-compute[87365]:   </os>
Nov 08 13:44:26 user nova-compute[87365]:   <features>
Nov 08 13:44:26 user nova-compute[87365]:     <acpi/>
Nov 08 13:44:26 user nova-compute[87365]:     <apic/>
Nov 08 13:44:26 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:44:26 user nova-compute[87365]:   </features>
Nov 08 13:44:26 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:44:26 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:44:26 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:44:26 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:44:26 user nova-compute[87365]:   </clock>
Nov 08 13:44:26 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:44:26 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:44:26 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:44:26 user nova-compute[87365]:   </cpu>
Nov 08 13:44:26 user nova-compute[87365]:   <devices>
Nov 08 13:44:26 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:44:26 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:44:26 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk"/>
Nov 08 13:44:26 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:44:26 user nova-compute[87365]:     </disk>
Nov 08 13:44:26 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:44:26 user nova-compute[87365]:       <mac address="fa:16:3e:6a:04:64"/>
Nov 08 13:44:26 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:26 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:44:26 user nova-compute[87365]:       <target dev="tap96de7723-5a"/>
Nov 08 13:44:26 user nova-compute[87365]:     </interface>
Nov 08 13:44:26 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:44:26 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/console.log" append="off"/>
Nov 08 13:44:26 user nova-compute[87365]:     </serial>
Nov 08 13:44:26 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:44:26 user nova-compute[87365]:     <video>
Nov 08 13:44:26 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:26 user nova-compute[87365]:     </video>
Nov 08 13:44:26 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:44:26 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:44:26 user nova-compute[87365]:     </rng>
Nov 08 13:44:26 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:44:26 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:44:26 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:44:26 user nova-compute[87365]:     </memballoon>
Nov 08 13:44:26 user nova-compute[87365]:   </devices>
Nov 08 13:44:26 user nova-compute[87365]: </domain>
Nov 08 13:44:26 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-152995279',display_name='tempest-VolumesAssistedSnapshotsTest-server-152995279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-152995279',id=10,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPyPPQ8Z6WvNaatA9jYSz8jpUMSjTUNQ6khirv34KOigulkb7+MF8t/BHPExhKuLcuLXq+IkiGTmGQ1KVhNr6ohmPDSSYfStUoNyQaUJv4Qz7WPEs+JPsv0cljn0DZSog==',key_name='tempest-keypair-1737111603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b953219fed343b6bf6d0776e1ad43b3',ramdisk_id='',reservation_id='r-0c1fx06h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-816186852',owner_user_name='tempest-VolumesAssistedSnapshotsTest-816186852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa552e93fa4d5180f81ac161f516af',uuid=9743709b-872f-4248-bc61-b41122126030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converting VIF {"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG os_vif [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0af79c81-18ad-5c31-af88-d9ac3555dce7', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96de7723-5a, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96de7723-5a, col_values=(('qos', UUID('5e9893fc-1fff-46e7-ab1f-9afcec07a0cd')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96de7723-5a, col_values=(('external_ids', {'iface-id': '96de7723-5a4f-4126-ae3e-1d9ea45ada5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:04:64', 'vm-uuid': '9743709b-872f-4248-bc61-b41122126030'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:26 user nova-compute[87365]: INFO os_vif [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a')
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] No VIF found with MAC fa:16:3e:6a:04:64, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:44:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.997s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 9743709b-872f-4248-bc61-b41122126030] Skipping network cache update for instance because it is Building. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:44:27 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] Acquiring lock "9743709b-872f-4248-bc61-b41122126030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] No waiting events found dispatching network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:28 user nova-compute[87365]: WARNING nova.compute.manager [req-1334afeb-2dfe-4b7c-bb08-b763fbf44e69 req-11835ee0-8d3a-4f21-bc67-6201a3de94d6 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received unexpected event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b for instance with vm_state building and task_state spawning.
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:44:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance spawned successfully.
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] Acquiring lock "9743709b-872f-4248-bc61-b41122126030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] No waiting events found dispatching network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:44:30 user nova-compute[87365]: WARNING nova.compute.manager [req-36c4bc67-0639-46d8-9f55-874d0da861fc req-f74f8041-4596-4be1-9ca2-d80e26e09eb9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received unexpected event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b for instance with vm_state building and task_state spawning.
Nov 08 13:44:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:30 user nova-compute[87365]: INFO nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 08 13:44:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:44:30 user nova-compute[87365]: INFO nova.compute.manager [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Took 8.27 seconds to build instance.
Nov 08 13:44:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36a016c2-c8d5-47f7-80f9-26cfec768259 tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.477s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:44:57 user nova-compute[87365]: INFO nova.compute.claims [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Claim successful on node user
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:44:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:44:57 user nova-compute[87365]: DEBUG nova.policy [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79591337fdf04987a71c530710f02cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbc55af780947ccb2be9cc2c159d611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:44:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Creating image(s)
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "/opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "/opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "/opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Successfully created port: 821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk 1073741824" returned: 0 in 0.051s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Cannot resize image /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Ensure instance console log exists: /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:44:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Successfully updated port: 821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquired lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-changed-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Refreshing instance network info cache due to event network-changed-821ffb6c-e822-478c-9856-5bca62409400. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] Acquiring lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Updating instance_info_cache with network_info: [{"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Releasing lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Instance network_info: |[{"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] Acquired lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Refreshing network info cache for port 821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Start _get_guest_xml network_info=[{"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:44:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105886267',display_name='tempest-VolumesActionsTest-instance-1105886267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105886267',id=11,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-ozrm4hye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:58Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=bff734c0-7eb2-4073-83e7-b60a1d0275d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lazy-loading 'pci_devices' on Instance uuid bff734c0-7eb2-4073-83e7-b60a1d0275d5 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:44:59 user nova-compute[87365]:   <uuid>bff734c0-7eb2-4073-83e7-b60a1d0275d5</uuid>
Nov 08 13:44:59 user nova-compute[87365]:   <name>instance-0000000b</name>
Nov 08 13:44:59 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:44:59 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:44:59 user nova-compute[87365]:   <metadata>
Nov 08 13:44:59 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:44:59 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:name>tempest-VolumesActionsTest-instance-1105886267</nova:name>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:44:59</nova:creationTime>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:44:59 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:44:59 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:owner>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:user uuid="79591337fdf04987a71c530710f02cb4">tempest-VolumesActionsTest-1737829010-project-member</nova:user>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:project uuid="ecbc55af780947ccb2be9cc2c159d611">tempest-VolumesActionsTest-1737829010</nova:project>
Nov 08 13:44:59 user nova-compute[87365]:       </nova:owner>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:44:59 user nova-compute[87365]:       <nova:ports>
Nov 08 13:44:59 user nova-compute[87365]:         <nova:port uuid="821ffb6c-e822-478c-9856-5bca62409400">
Nov 08 13:44:59 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:44:59 user nova-compute[87365]:         </nova:port>
Nov 08 13:44:59 user nova-compute[87365]:       </nova:ports>
Nov 08 13:44:59 user nova-compute[87365]:     </nova:instance>
Nov 08 13:44:59 user nova-compute[87365]:   </metadata>
Nov 08 13:44:59 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:44:59 user nova-compute[87365]:     <system>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="serial">bff734c0-7eb2-4073-83e7-b60a1d0275d5</entry>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="uuid">bff734c0-7eb2-4073-83e7-b60a1d0275d5</entry>
Nov 08 13:44:59 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:44:59 user nova-compute[87365]:     </system>
Nov 08 13:44:59 user nova-compute[87365]:   </sysinfo>
Nov 08 13:44:59 user nova-compute[87365]:   <os>
Nov 08 13:44:59 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:44:59 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:44:59 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:44:59 user nova-compute[87365]:   </os>
Nov 08 13:44:59 user nova-compute[87365]:   <features>
Nov 08 13:44:59 user nova-compute[87365]:     <acpi/>
Nov 08 13:44:59 user nova-compute[87365]:     <apic/>
Nov 08 13:44:59 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:44:59 user nova-compute[87365]:   </features>
Nov 08 13:44:59 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:44:59 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:44:59 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:44:59 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:44:59 user nova-compute[87365]:   </clock>
Nov 08 13:44:59 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:44:59 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:44:59 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:44:59 user nova-compute[87365]:   </cpu>
Nov 08 13:44:59 user nova-compute[87365]:   <devices>
Nov 08 13:44:59 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:44:59 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:44:59 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk"/>
Nov 08 13:44:59 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:44:59 user nova-compute[87365]:     </disk>
Nov 08 13:44:59 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:44:59 user nova-compute[87365]:       <mac address="fa:16:3e:77:cf:c2"/>
Nov 08 13:44:59 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:59 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:44:59 user nova-compute[87365]:       <target dev="tap821ffb6c-e8"/>
Nov 08 13:44:59 user nova-compute[87365]:     </interface>
Nov 08 13:44:59 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:44:59 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/console.log" append="off"/>
Nov 08 13:44:59 user nova-compute[87365]:     </serial>
Nov 08 13:44:59 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:44:59 user nova-compute[87365]:     <video>
Nov 08 13:44:59 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:44:59 user nova-compute[87365]:     </video>
Nov 08 13:44:59 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:44:59 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:44:59 user nova-compute[87365]:     </rng>
Nov 08 13:44:59 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:44:59 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:44:59 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:44:59 user nova-compute[87365]:     </memballoon>
Nov 08 13:44:59 user nova-compute[87365]:   </devices>
Nov 08 13:44:59 user nova-compute[87365]: </domain>
Nov 08 13:44:59 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105886267',display_name='tempest-VolumesActionsTest-instance-1105886267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105886267',id=11,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-ozrm4hye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:44:58Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=bff734c0-7eb2-4073-83e7-b60a1d0275d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG os_vif [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac521edd-5447-58bc-8041-8758e2bcad07', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap821ffb6c-e8, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap821ffb6c-e8, col_values=(('qos', UUID('2c8131b2-ed9f-4e84-9693-80961151051c')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap821ffb6c-e8, col_values=(('external_ids', {'iface-id': '821ffb6c-e822-478c-9856-5bca62409400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:cf:c2', 'vm-uuid': 'bff734c0-7eb2-4073-83e7-b60a1d0275d5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:44:59 user nova-compute[87365]: INFO os_vif [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8')
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] No VIF found with MAC fa:16:3e:77:cf:c2, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Updated VIF entry in instance network info cache for port 821ffb6c-e822-478c-9856-5bca62409400. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Updating instance_info_cache with network_info: [{"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:44:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89bec6ef-2563-4626-9836-a644899a1bb6 req-51faee1c-2f82-4eeb-9e61-89a67bb38fbd service nova] Releasing lock "refresh_cache-bff734c0-7eb2-4073-83e7-b60a1d0275d5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] No waiting events found dispatching network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:01 user nova-compute[87365]: WARNING nova.compute.manager [req-ca722d0d-bd4c-44ef-823f-0aae81550757 req-f49e969b-8f60-4133-a572-ee6c3693f70a service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received unexpected event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 for instance with vm_state building and task_state spawning.
Nov 08 13:45:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:45:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Instance spawned successfully.
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] No waiting events found dispatching network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:03 user nova-compute[87365]: WARNING nova.compute.manager [req-680a3cb8-b41a-4d41-bf60-3e350dd9831f req-204f7c42-7f23-401c-979d-ee22e1efec92 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received unexpected event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 for instance with vm_state building and task_state spawning.
Nov 08 13:45:03 user nova-compute[87365]: INFO nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 08 13:45:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:45:04 user nova-compute[87365]: INFO nova.compute.manager [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Took 6.88 seconds to build instance.
Nov 08 13:45:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8fbced8f-2c24-47d5-afa0-dd639350fc72 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:45:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:45:21 user nova-compute[87365]: INFO nova.compute.manager [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] instance snapshotting
Nov 08 13:45:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Beginning live snapshot process
Nov 08 13:45:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:45:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:45:22 user nova-compute[87365]: INFO nova.compute.claims [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Claim successful on node user
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:22 user nova-compute[87365]: INFO nova.compute.manager [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Rescuing
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.235s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26.delta 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26.delta 1073741824" returned: 0 in 0.063s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Checking UEFI support for host arch (x86_64) {{(pid=87365) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 13:45:22 user nova-compute[87365]: INFO nova.virt.libvirt.host [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] UEFI support detected
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.751s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:45:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG nova.policy [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8fc23eee9e94d759b90e2b9308d1d29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9ea00630e945f9864ee305176c45c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:45:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:45:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Creating image(s)
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "/opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "/opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:23 user nova-compute[87365]: WARNING nova.compute.manager [req-9cd6909d-703f-41ae-b9a6-9afe8ff95733 req-cc9f1fab-ab40-4798-9b22-2b195c2bafe0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state rescuing.
Nov 08 13:45:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] COPY block job progress, current cursor: 1638400 final cursor: 75497472 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.226s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk 1073741824" returned: 0 in 0.133s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance destroyed successfully.
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] COPY block job progress, current cursor: 26476544 final cursor: 75497472 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:45:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Attempting rescue
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=87365) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:45:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Creating image(s)
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Successfully created port: 558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Cannot resize image /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.256s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue" returned: 0 in 0.061s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'migration_context' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<8ae2c4a4-aff6-4be8-be12-9e1df495c20e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start _get_guest_xml network_info=[{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:c9:56:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'resources' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<8ae2c4a4-aff6-4be8-be12-9e1df495c20e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<8ae2c4a4-aff6-4be8-be12-9e1df495c20e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:45:24 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:24 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<8ae2c4a4-aff6-4be8-be12-9e1df495c20e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-421730953',display_name='tempest-ServerRescueNegativeTestJSON-server-421730953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-421730953',id=5,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-0bezjqai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:50Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=8ae2c4a4-aff6-4be8-be12-9e1df495c20e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:c9:56:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:c9:56:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:45:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<8ae2c4a4-aff6-4be8-be12-9e1df495c20e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:45:24 user nova-compute[87365]:   <uuid>8ae2c4a4-aff6-4be8-be12-9e1df495c20e</uuid>
Nov 08 13:45:24 user nova-compute[87365]:   <name>instance-00000005</name>
Nov 08 13:45:24 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:45:24 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:45:24 user nova-compute[87365]:   <metadata>
Nov 08 13:45:24 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:45:24 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-421730953</nova:name>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:45:24</nova:creationTime>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:45:24 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:45:24 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:owner>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:user uuid="74300a84ce074dd38166c961d57071cd">tempest-ServerRescueNegativeTestJSON-954030017-project-member</nova:user>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:project uuid="4ddd66e9d6104a2c8e71279551cb6b4d">tempest-ServerRescueNegativeTestJSON-954030017</nova:project>
Nov 08 13:45:24 user nova-compute[87365]:       </nova:owner>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:45:24 user nova-compute[87365]:       <nova:ports>
Nov 08 13:45:24 user nova-compute[87365]:         <nova:port uuid="60b8cbb7-f771-411b-9de9-effae55c61fe">
Nov 08 13:45:24 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 13:45:24 user nova-compute[87365]:         </nova:port>
Nov 08 13:45:24 user nova-compute[87365]:       </nova:ports>
Nov 08 13:45:24 user nova-compute[87365]:     </nova:instance>
Nov 08 13:45:24 user nova-compute[87365]:   </metadata>
Nov 08 13:45:24 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:45:24 user nova-compute[87365]:     <system>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="serial">8ae2c4a4-aff6-4be8-be12-9e1df495c20e</entry>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="uuid">8ae2c4a4-aff6-4be8-be12-9e1df495c20e</entry>
Nov 08 13:45:24 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:45:24 user nova-compute[87365]:     </system>
Nov 08 13:45:24 user nova-compute[87365]:   </sysinfo>
Nov 08 13:45:24 user nova-compute[87365]:   <os>
Nov 08 13:45:24 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:45:24 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:45:24 user nova-compute[87365]:   </os>
Nov 08 13:45:24 user nova-compute[87365]:   <features>
Nov 08 13:45:24 user nova-compute[87365]:     <acpi/>
Nov 08 13:45:24 user nova-compute[87365]:     <apic/>
Nov 08 13:45:24 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:45:24 user nova-compute[87365]:   </features>
Nov 08 13:45:24 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:45:24 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:45:24 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:45:24 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:45:24 user nova-compute[87365]:   </clock>
Nov 08 13:45:24 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:45:24 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:45:24 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:45:24 user nova-compute[87365]:   </cpu>
Nov 08 13:45:24 user nova-compute[87365]:   <devices>
Nov 08 13:45:24 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:45:24 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:45:24 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue"/>
Nov 08 13:45:24 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:45:24 user nova-compute[87365]:     </disk>
Nov 08 13:45:24 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:45:24 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:45:24 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk"/>
Nov 08 13:45:24 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:45:24 user nova-compute[87365]:     </disk>
Nov 08 13:45:24 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:45:24 user nova-compute[87365]:       <mac address="fa:16:3e:c9:56:f3"/>
Nov 08 13:45:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:45:24 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:45:24 user nova-compute[87365]:       <target dev="tap60b8cbb7-f7"/>
Nov 08 13:45:24 user nova-compute[87365]:     </interface>
Nov 08 13:45:24 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:45:24 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/console.log" append="off"/>
Nov 08 13:45:24 user nova-compute[87365]:     </serial>
Nov 08 13:45:24 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:45:24 user nova-compute[87365]:     <video>
Nov 08 13:45:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:45:24 user nova-compute[87365]:     </video>
Nov 08 13:45:24 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:45:24 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:45:24 user nova-compute[87365]:     </rng>
Nov 08 13:45:24 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:45:24 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:45:24 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:45:24 user nova-compute[87365]:     </memballoon>
Nov 08 13:45:24 user nova-compute[87365]:   </devices>
Nov 08 13:45:24 user nova-compute[87365]: </domain>
Nov 08 13:45:24 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:45:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance destroyed successfully.
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No VIF found with MAC fa:16:3e:c9:56:f3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26.delta /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Successfully updated port: 558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquired lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-changed-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Refreshing instance network info cache due to event network-changed-558b65ae-5164-4258-bc81-eb482dbbb19b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] Acquiring lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26.delta /opt/stack/data/nova/instances/snapshots/tmph9ea3285/67e924a067d34c4a92e29321d1fe9d26" returned: 0 in 0.294s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Snapshot extracted, beginning image upload
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:25 user nova-compute[87365]: WARNING nova.compute.manager [req-1d2e35c5-e2e0-490c-82cd-88c695c879e6 req-183f6947-7720-4166-ba15-e57c786585e2 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state rescuing.
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Updating instance_info_cache with network_info: [{"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Releasing lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Instance network_info: |[{"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] Acquired lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Refreshing network info cache for port 558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Start _get_guest_xml network_info=[{"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:45:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:25 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-56811682',display_name='tempest-ServersNegativeTestJSON-server-56811682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-56811682',id=12,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-1irb3nj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:23Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=5a8efc2a-3c53-4899-a716-7f193afe0e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a8efc2a-3c53-4899-a716-7f193afe0e1c {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:45:25 user nova-compute[87365]:   <uuid>5a8efc2a-3c53-4899-a716-7f193afe0e1c</uuid>
Nov 08 13:45:25 user nova-compute[87365]:   <name>instance-0000000c</name>
Nov 08 13:45:25 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:45:25 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:45:25 user nova-compute[87365]:   <metadata>
Nov 08 13:45:25 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:45:25 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:name>tempest-ServersNegativeTestJSON-server-56811682</nova:name>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:45:25</nova:creationTime>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:45:25 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:45:25 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:owner>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:user uuid="e8fc23eee9e94d759b90e2b9308d1d29">tempest-ServersNegativeTestJSON-868089155-project-member</nova:user>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:project uuid="6c9ea00630e945f9864ee305176c45c8">tempest-ServersNegativeTestJSON-868089155</nova:project>
Nov 08 13:45:25 user nova-compute[87365]:       </nova:owner>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:45:25 user nova-compute[87365]:       <nova:ports>
Nov 08 13:45:25 user nova-compute[87365]:         <nova:port uuid="558b65ae-5164-4258-bc81-eb482dbbb19b">
Nov 08 13:45:25 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 13:45:25 user nova-compute[87365]:         </nova:port>
Nov 08 13:45:25 user nova-compute[87365]:       </nova:ports>
Nov 08 13:45:25 user nova-compute[87365]:     </nova:instance>
Nov 08 13:45:25 user nova-compute[87365]:   </metadata>
Nov 08 13:45:25 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:45:25 user nova-compute[87365]:     <system>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="serial">5a8efc2a-3c53-4899-a716-7f193afe0e1c</entry>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="uuid">5a8efc2a-3c53-4899-a716-7f193afe0e1c</entry>
Nov 08 13:45:25 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:45:25 user nova-compute[87365]:     </system>
Nov 08 13:45:25 user nova-compute[87365]:   </sysinfo>
Nov 08 13:45:25 user nova-compute[87365]:   <os>
Nov 08 13:45:25 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:45:25 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:45:25 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:45:25 user nova-compute[87365]:   </os>
Nov 08 13:45:25 user nova-compute[87365]:   <features>
Nov 08 13:45:25 user nova-compute[87365]:     <acpi/>
Nov 08 13:45:25 user nova-compute[87365]:     <apic/>
Nov 08 13:45:25 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:45:25 user nova-compute[87365]:   </features>
Nov 08 13:45:25 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:45:25 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:45:25 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:45:25 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:45:25 user nova-compute[87365]:   </clock>
Nov 08 13:45:25 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:45:25 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:45:25 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:45:25 user nova-compute[87365]:   </cpu>
Nov 08 13:45:25 user nova-compute[87365]:   <devices>
Nov 08 13:45:25 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:45:25 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:45:25 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk"/>
Nov 08 13:45:25 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:45:25 user nova-compute[87365]:     </disk>
Nov 08 13:45:25 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:45:25 user nova-compute[87365]:       <mac address="fa:16:3e:b1:72:15"/>
Nov 08 13:45:25 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:45:25 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:45:25 user nova-compute[87365]:       <target dev="tap558b65ae-51"/>
Nov 08 13:45:25 user nova-compute[87365]:     </interface>
Nov 08 13:45:25 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:45:25 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/console.log" append="off"/>
Nov 08 13:45:25 user nova-compute[87365]:     </serial>
Nov 08 13:45:25 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:45:25 user nova-compute[87365]:     <video>
Nov 08 13:45:25 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:45:25 user nova-compute[87365]:     </video>
Nov 08 13:45:25 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:45:25 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:45:25 user nova-compute[87365]:     </rng>
Nov 08 13:45:25 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:45:25 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:45:25 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:45:25 user nova-compute[87365]:     </memballoon>
Nov 08 13:45:25 user nova-compute[87365]:   </devices>
Nov 08 13:45:25 user nova-compute[87365]: </domain>
Nov 08 13:45:25 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-56811682',display_name='tempest-ServersNegativeTestJSON-server-56811682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-56811682',id=12,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-1irb3nj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:23Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=5a8efc2a-3c53-4899-a716-7f193afe0e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG os_vif [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '493b73da-5ff4-5bcc-94e9-a3ede0b04234', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap558b65ae-51, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap558b65ae-51, col_values=(('qos', UUID('4e70538b-dd47-4396-b852-714550b79e02')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap558b65ae-51, col_values=(('external_ids', {'iface-id': '558b65ae-5164-4258-bc81-eb482dbbb19b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:72:15', 'vm-uuid': '5a8efc2a-3c53-4899-a716-7f193afe0e1c'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:25 user nova-compute[87365]: INFO os_vif [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51')
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] No VIF found with MAC fa:16:3e:b1:72:15, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Updated VIF entry in instance network info cache for port 558b65ae-5164-4258-bc81-eb482dbbb19b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Updating instance_info_cache with network_info: [{"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d65bab22-e8a6-46d0-9452-ed5b9568a26a req-2bc3dd7a-0862-4587-b90b-a146405bd4e3 service nova] Releasing lock "refresh_cache-5a8efc2a-3c53-4899-a716-7f193afe0e1c" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:27 user nova-compute[87365]: WARNING nova.compute.manager [req-815eccf9-a176-4e33-afef-fbb38eafa55e req-38d7676f-7af9-4136-8e13-bf631d04b0d5 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state rescuing.
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lazy-loading 'flavor' on Instance uuid e76e8a31-d8a3-4053-8a20-53fcccaacd82 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.138s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:27 user nova-compute[87365]: INFO nova.compute.manager [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Attaching volume 8c2b6202-e8b9-4ad9-ac64-84073e28455f to /dev/vdb
Nov 08 13:45:28 user nova-compute[87365]: DEBUG os_brick.utils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:45:28 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprci3st1o/privsep.sock']
Nov 08 13:45:28 user sudo[99214]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprci3st1o/privsep.sock
Nov 08 13:45:28 user sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 13:45:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Snapshot image upload complete
Nov 08 13:45:28 user nova-compute[87365]: INFO nova.compute.manager [None req-293502b0-fce2-4222-be02-0996e975c7d9 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Took 6.91 seconds to snapshot the instance on the hypervisor.
Nov 08 13:45:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] No waiting events found dispatching network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:28 user nova-compute[87365]: WARNING nova.compute.manager [req-32760499-db4e-4ee7-96e2-d8f4e7b560fc req-75035b44-2298-46f1-8aed-c158ef474782 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received unexpected event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b for instance with vm_state building and task_state spawning.
Nov 08 13:45:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing instance network info cache due to event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user sudo[99214]: pam_unix(sudo:session): session closed for user root
Nov 08 13:45:30 user nova-compute[87365]: INFO oslo.privsep.daemon [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Spawned new privsep daemon via rootwrap
Nov 08 13:45:30 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 13:45:30 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 13:45:30 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 13:45:30 user nova-compute[87365]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 99274
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.network.neutron [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated VIF entry in instance network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.network.neutron [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd92ef-04d5-4dba-9371-ee7e2b846aaf]: (2,) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:30 user nova-compute[87365]: WARNING nova.compute.manager [req-a8616672-4d62-40ff-8f28-4e037ad0b44c req-e4305200-e84c-4c14-b188-86042c52fe2c service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state active and task_state rescuing.
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f04eef-c315-4106-9fb2-5645aabe4945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: WARNING os_brick.initiator.connectors.nvmeof [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594a744-ac6f-437b-965b-ffac5407b36b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce390c-0998-45a3-8308-479f922a83ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eac922-c129-4514-9116-44cb95c866d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:30 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0db83f-1187-4988-a5f2-58a3259c14f4]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG os_brick.utils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] <== get_connector_properties: return (2374ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Updating existing volume attachment record: 2339e9e8-d030-4ad6-ac13-15fa81e47e12 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c8256730-b4a5-4766-b4da-c46f829bde75 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:45:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Instance spawned successfully.
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] No waiting events found dispatching network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:45:30 user nova-compute[87365]: WARNING nova.compute.manager [req-b5b9de79-830e-48c6-8cbc-019919dd2ec6 req-150f96af-c06c-4e25-9ac0-c8aff274d303 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received unexpected event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b for instance with vm_state building and task_state spawning.
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:30 user nova-compute[87365]: INFO nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Took 7.57 seconds to spawn the instance on the hypervisor.
Nov 08 13:45:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:45:30 user nova-compute[87365]: INFO nova.compute.manager [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Took 8.91 seconds to build instance.
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f19adc2f-0564-4ddf-b4e9-61b10e50c71e tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.053s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:31 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:31 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=6866MB free_disk=24.810104370117188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e76e8a31-d8a3-4053-8a20-53fcccaacd82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9743709b-872f-4248-bc61-b41122126030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bff734c0-7eb2-4073-83e7-b60a1d0275d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5a8efc2a-3c53-4899-a716-7f193afe0e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:45:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:45:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-changed-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Refreshing instance network info cache due to event network-changed-8fef3506-2f29-4a7c-8092-d327f43f627e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] Acquiring lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] Acquired lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Refreshing network info cache for port 8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updated VIF entry in instance network info cache for port 8fef3506-2f29-4a7c-8092-d327f43f627e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating instance_info_cache with network_info: [{"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8958b92b-3c8b-4e6d-9e5e-f0c69b6619e4 req-8e5d52d2-2828-430c-88e0-9537bd9f44aa service nova] Releasing lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-changed-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Refreshing instance network info cache due to event network-changed-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] Acquiring lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] Acquired lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Refreshing network info cache for port ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updated VIF entry in instance network info cache for port ce489c81-8bbf-45eb-b1bf-1cc7da2a2023. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating instance_info_cache with network_info: [{"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-159918a3-6549-491a-9e3c-860554d60c0c req-43c53503-fb38-414f-b37f-2d3c140589e3 service nova] Releasing lock "refresh_cache-5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:45:42 user nova-compute[87365]: INFO nova.compute.claims [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Claim successful on node user
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:45:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:45:42 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:45:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:45:43 user nova-compute[87365]: INFO nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Booting with volume 36cc0e21-f366-44e8-92d5-3bee25be6ffd at /dev/vda
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[44463243-20ea-4b53-a69b-f478318b955e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5fc099-1bd2-497b-84b4-df1a98272692]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c37996-8584-4b08-aafb-2e7055224d4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a656bdd-ca47-4d46-9628-c2f086c98734]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:43 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:45:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[01324c9f-01d6-49fa-8e83-658af343bbc8]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating existing volume attachment record: 3361de69-92e1-4994-83a1-f55e0345913d {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:45:43 user nova-compute[87365]: DEBUG nova.policy [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14a50a4f5253401dbb4647133d73ecca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e921e38cdc46f6b9e82be020e4c982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:45:44 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully created port: 7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:44 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully created port: 8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully created port: c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:46 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully created port: 6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:46 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully created port: 18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: 7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-7bd652d1-1c41-4309-b3b1-658c10d9cf0d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-72c9152f-04e5-4beb-8782-f8fb7560c967 req-98d4395e-ff4f-4ab5-bb7e-ce10e016d2a4 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lazy-loading 'flavor' on Instance uuid 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: 6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:45:48 user nova-compute[87365]: INFO nova.compute.manager [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Attaching volume 25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 to /dev/sdc
Nov 08 13:45:48 user nova-compute[87365]: DEBUG os_brick.utils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6befb18f-8231-44ed-bd14-3c05044db831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4554a8d-f7ee-40aa-91cd-60cbff4bb983]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1fcb76-6752-42a7-9064-57006ea314fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45087b0-1aa0-4308-a168-86a3b6cf38cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:45:48 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:45:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba080d5-c7e7-4ffc-b39f-08555cade6f2]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:45:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG os_brick.utils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating existing volume attachment record: f55db7d8-51d1-4210-aa72-4dad10af429c {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-f0d1ec9d-444c-48c8-8037-97b39a953724. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: 8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-6ea3bd8d-376e-4192-9cc6-d9548af4d496. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc7100cc-9caf-47e8-b90e-4e3431fe3a20 req-7998abb0-db34-4d89-a193-5f876b5badf4 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0cd58f7-3731-4696-be5e-5bff3fd581e2 req-2288b9ee-e126-420e-b7df-958ef77825ea service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: 6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Successfully updated port: 18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-8d3d170e-87b7-4968-a83b-38a3a9a0c232. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-6b4e8509-7c27-40e9-a9b8-30a9d94adff8. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance network_info: |[{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.network.neutron [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.network.neutron [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updated VIF entry in instance network info cache for port 8d3d170e-87b7-4968-a83b-38a3a9a0c232. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.network.neutron [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-83abba05-55d7-431d-bb18-cd3a12f456f2 req-11b2a02a-821b-43f6-9bad-59dec60f713d service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:53 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updated VIF entry in instance network info cache for port 6b4e8509-7c27-40e9-a9b8-30a9d94adff8. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-18a6839a-9731-4d8d-8e7d-48656f5983d4. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:45:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:45:55 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updated VIF entry in instance network info cache for port 18a6839a-9731-4d8d-8e7d-48656f5983d4. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:45:55 user nova-compute[87365]: DEBUG nova.network.neutron [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:45:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d9db00a-277b-4f62-8c2f-661b7ecec923 req-547b31ee-a095-43eb-8b97-9d80dfeb8980 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:45:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:45:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connector [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Factory for ISCSI on None {{(pid=87365) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeTOJoZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:00 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[08538772-83e9-431e-a574-28b33e0e55cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:46:00 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b98fb-de4d-43b0-99a0-18b1a0412a9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f] added
Nov 08 13:46:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[427901a8-cda1-4f7a-bb0d-487e539bec55]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[09561b40-c864-43df-ab78-6e4fef98dee4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AeTOJoZx {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AeTOJoZx" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3e95b-b655-48b2-ac8b-47284fa86da9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AeTOJoZx'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ab3850-0a37-463d-bb8a-23a4ff003d5d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[16077993-e10e-47ff-93d1-706a7f845bab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 13:46:00 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 13:46:00 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 13:46:00 user nova-compute[87365]: 
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b8a897-2316-4b15-82f7-dd459a00b0c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260]
Nov 08 13:46:00 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a92be0-3d43-491d-89ff-d133abacf49a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'flavor' on Instance uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2e4d31-1565-41f7-b5d8-c3648d6c10d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4709583-8169-47d2-a3ca-15a290835b19]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeTOJoZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:46:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:01 user nova-compute[87365]: INFO nova.compute.manager [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Attaching volume 114d5710-7c6b-415e-be43-6735c8f85da2 to /dev/vdb
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.utils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ee281-bb7e-48bc-b092-3295c3c003f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6620de60-0368-42e2-94aa-2c61c5a920ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c09bcea-a61f-42aa-a01a-a271da4726b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[386f01dc-9c2d-4424-b4ec-2fda1c0fc811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:01 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfafc2-7ad9-4dd7-b527-45d8458a0273]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.utils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating existing volume attachment record: a14d1fba-d0e7-4ec8-9b0c-056bc4b90e65 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26432343536353566', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432343536353566', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lazy-loading 'flavor' on Instance uuid e76e8a31-d8a3-4053-8a20-53fcccaacd82 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:46:01 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:01 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:46:01 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:46:01 user nova-compute[87365]:   <serial>8c2b6202-e8b9-4ad9-ac64-84073e28455f</serial>
Nov 08 13:46:01 user nova-compute[87365]: </disk>
Nov 08 13:46:01 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] No VIF found with MAC fa:16:3e:5b:a0:a3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-changed-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Refreshing instance network info cache due to event network-changed-fdcefe60-e73a-445e-a6b7-dbe20f600efb. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] Acquiring lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] Acquired lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Refreshing network info cache for port fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updated VIF entry in instance network info cache for port fdcefe60-e73a-445e-a6b7-dbe20f600efb. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updating instance_info_cache with network_info: [{"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cd4cee53-61c0-4c10-b8f1-4a14a6ed0467 req-774e8b7d-6e78-49c0-b0df-85330abe91d4 service nova] Releasing lock "refresh_cache-f33f05cc-e996-4596-bd14-c47e64994f89" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e86174d-8fd1-4758-a8f2-aa4847431fba tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.103s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG nova.objects.instance [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lazy-loading 'flavor' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:08 user nova-compute[87365]: INFO nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Booting with volume c1ddeaa8-d88a-455d-8cb4-37f75861b495 at /dev/vdb
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6d19e-9210-459b-82c5-21748d6122be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d86d88-ef52-4b80-86a0-10215f4f52e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09216dd-95b4-418e-84b6-5f7c761e4109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6384c77-4476-454f-b636-8733230e0768]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:08 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1720aaee-0122-495a-834b-4e7c2808f55e]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating existing volume attachment record: 1c7fd631-5f12-40c5-b68e-0fc56c79bc0d {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:08 user nova-compute[87365]: INFO nova.compute.manager [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attaching volume bb7cee04-ba81-4e92-be4d-36db9206705f to /dev/vdb
Nov 08 13:46:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZMicmns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:13 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:13 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:13 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fd5e4-b87e-4d70-b134-4b05c1f96c0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:46:13 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-changed-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Refreshing instance network info cache due to event network-changed-96de7723-5a4f-4126-ae3e-1d9ea45ada5b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] Acquiring lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] Acquired lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Refreshing network info cache for port 96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[902a795b-647b-4aa5-b05b-f40858ba283d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4] added
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[96617ca0-8b58-4c08-8bac-a922c4a4ff74]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f772ecf-bd99-4fe0-b9ad-0ee1c805e9e8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZMicmns {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZMicmns" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f6ce9f-be7f-4eee-b491-34152170476b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yZMicmns'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d782bdfa-a7be-4f6b-a08f-a0d689afccda]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[533ba040-f344-4690-9611-39ec53750d9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f9777-7b6f-449f-87a5-285900cbf4f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260]
Nov 08 13:46:13 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f638ab0-496b-4b8e-b7e6-798d56efc545]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43a576-f3a0-4444-baef-3a83c5086843]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:13 user nova-compute[87365]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:13 user nova-compute[87365]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.utils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd17a4-0b3a-44ff-abca-bbfb13d95dd6]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZMicmns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb87218-be6b-4c94-adf8-9621c824e542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45d530-bcd5-4ac1-9ae7-c0ffdbd6a022]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717fc61-82b9-45e3-9f22-5503485d1232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd38cc-fb53-4a57-ab1e-032e64185f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:13 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f8d6b-d06c-436a-b4fc-662336bd203c]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG os_brick.utils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updating existing volume attachment record: 5597c5fa-8a8e-482f-8cb3-ba28d84019eb {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "9743709b-872f-4248-bc61-b41122126030" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lazy-loading 'flavor' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Updated VIF entry in instance network info cache for port 96de7723-5a4f-4126-ae3e-1d9ea45ada5b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Updating instance_info_cache with network_info: [{"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79539f27-98a8-4885-9063-2de902cfa57a req-63307fb9-d830-4201-8da9-df0fe69eccf9 service nova] Releasing lock "refresh_cache-9743709b-872f-4248-bc61-b41122126030" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:13 user nova-compute[87365]: INFO nova.compute.manager [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Terminating instance
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-unplugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] No waiting events found dispatching network-vif-unplugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:46:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4a21de2-f783-4e1b-8995-608cb08b96c3 req-c7843f04-9439-4aee-b143-7375f2c05a28 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-unplugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23962346138643830', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962346138643830', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lazy-loading 'flavor' on Instance uuid 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Instance destroyed successfully.
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lazy-loading 'resources' on Instance uuid e76e8a31-d8a3-4053-8a20-53fcccaacd82 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:46:14 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:14 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:46:14 user nova-compute[87365]:   <target dev="sdc" bus="scsi"/>
Nov 08 13:46:14 user nova-compute[87365]:   <serial>25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4</serial>
Nov 08 13:46:14 user nova-compute[87365]:   <address type="drive" controller="0" unit="2"/>
Nov 08 13:46:14 user nova-compute[87365]: </disk>
Nov 08 13:46:14 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1686156355',display_name='tempest-DeleteServersTestJSON-server-1686156355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1686156355',id=3,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d6c54187f6d4f278fc577a31b0ca9af',ramdisk_id='',reservation_id='r-jhtoljsx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1670689215',owner_user_name='tempest-DeleteServersTestJSON-1670689215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:43:49Z,user_data=None,user_id='0e066454e9ac4ba29ba82dbd75cf81ef',uuid=e76e8a31-d8a3-4053-8a20-53fcccaacd82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converting VIF {"id": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "address": "fa:16:3e:5b:a0:a3", "network": {"id": "908df350-7dd8-4897-a525-bddc73e3358d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-315569136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d6c54187f6d4f278fc577a31b0ca9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b7a7a6-d8", "ovs_interfaceid": "84b7a7a6-d8f3-4665-93d0-8db1086acf88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_vif [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84b7a7a6-d8, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8bf1ab5-68b4-46d6-8ba2-12e8bd4e2342) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:14 user nova-compute[87365]: INFO os_vif [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:a0:a3,bridge_name='br-int',has_traffic_filtering=True,id=84b7a7a6-d8f3-4665-93d0-8db1086acf88,network=Network(908df350-7dd8-4897-a525-bddc73e3358d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b7a7a6-d8')
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeTOJoZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:14 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a068c89-4f76-4e82-997f-dd80626bbf6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:46:14 user nova-compute[87365]: No targets found.
Nov 08 13:46:14 user nova-compute[87365]: iSNS:
Nov 08 13:46:14 user nova-compute[87365]: No targets found.
Nov 08 13:46:14 user nova-compute[87365]: STATIC:
Nov 08 13:46:14 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f
Nov 08 13:46:14 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:14 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:14 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4
Nov 08 13:46:14 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:14 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:14 user nova-compute[87365]: FIRMWARE:
Nov 08 13:46:14 user nova-compute[87365]: No targets found.
Nov 08 13:46:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:46:14 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:46:14 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f58a878-ea3f-4e5d-af02-ad870a69f0f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667f367-7365-4e36-9b52-7e4826542300]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:14 user nova-compute[87365]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f (non-flash)
Nov 08 13:46:14 user nova-compute[87365]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf8772d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc11aa-cc6e-4c00-bdbe-488f72dd2548]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe2c153-9cf1-4ec1-94eb-4a70263e0ff9]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca28d6a-2fc7-4df2-b30c-235ee0fc0aac]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b082c95c-4be1-4483-893b-0214a2d55e91]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef7607-4a85-4163-a979-5b8f4ffe81b6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2b92bd-cef9-4595-8901-efc97333f1ce]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260]
Nov 08 13:46:14 user nova-compute[87365]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2b6202-e8b9-4ad9-ac64-84073e28455f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a618dd7f-cf26-4a5e-9e8f-bbf27ae8d3a0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] <== disconnect_volume: return (273ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:46:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Deleting instance files /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82_del
Nov 08 13:46:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Deletion of /opt/stack/data/nova/instances/e76e8a31-d8a3-4053-8a20-53fcccaacd82_del complete
Nov 08 13:46:14 user nova-compute[87365]: INFO nova.compute.manager [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 13:46:14 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No BDM found with device name sda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No BDM found with device name sdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No BDM found with device name sdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] No VIF found with MAC fa:16:3e:68:b1:47, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:46:15 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:15 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Took 0.57 seconds to deallocate network for instance.
Nov 08 13:46:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-3d75195c-dc16-40ef-b0a4-109e14727e39 req-dd719281-cad4-42bf-8b7a-5474f430dbb7 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-deleted-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] Acquiring lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] No waiting events found dispatching network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:46:16 user nova-compute[87365]: WARNING nova.compute.manager [req-b20a4df3-c919-47e1-b2e4-b95ac8c1413e req-40bda652-8279-4916-85f9-8784c3eba007 service nova] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Received unexpected event network-vif-plugged-84b7a7a6-d8f3-4665-93d0-8db1086acf88 for instance with vm_state active and task_state deleting.
Nov 08 13:46:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:22 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:22 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziklmJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:25 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:25 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:25 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[76567580-64cb-4c91-bda3-19031e894a08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:46:25 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b3a035-7833-47ee-9752-c0147b9d3964]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2] added
Nov 08 13:46:25 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[92821108-102f-448a-9988-b03cba23210c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9cd3e-777f-42b6-87d6-5fe6a6e498f3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziklmJEA {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ziklmJEA" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[65255176-ab39-4fc7-a286-f817a1692f0d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ziklmJEA'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda85714-a2ec-4a39-883f-bc332ae8d3c0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb21f0d3-dce8-47cc-bef8-99a8dd0ecb5e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:25 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:25 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d997e62-af89-4744-bf25-30529ea7e34d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260]
Nov 08 13:46:25 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:25 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c2f40f5e-79ab-4b71-9fb4-2ac02578e026 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.174s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adee49b-a375-457c-a31a-c2272e7700d2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d182f-5c33-44b6-9872-18719e1301e8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:26 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:26 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:26 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:26 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[505cf25e-45e9-4e65-8392-56b0039d9075]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziklmJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:26 user nova-compute[87365]: INFO nova.compute.manager [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] [instance: e76e8a31-d8a3-4053-8a20-53fcccaacd82] Took 11.47 seconds to detach 1 volumes for instance.
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26530366333393535', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530366333393535', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "9743709b-872f-4248-bc61-b41122126030" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:27 user nova-compute[87365]: INFO nova.compute.manager [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Attaching volume 6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 to /dev/vdb
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.objects.instance [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'flavor' on Instance uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:46:27 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:27 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:46:27 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:46:27 user nova-compute[87365]:   <serial>114d5710-7c6b-415e-be43-6735c8f85da2</serial>
Nov 08 13:46:27 user nova-compute[87365]: </disk>
Nov 08 13:46:27 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.utils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe03a806-d749-4896-848f-9f1633271f3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf17c10-64a9-4e34-a9ee-c0480dfaa070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4084fab9-5b3b-49e1-ad6a-2e22db175a02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[43247c81-2ed7-4103-bfc7-afd372391e9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:27 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d198ccd7-1fa2-4c80-8f10-d1e462a73ed6]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG os_brick.utils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Updating existing volume attachment record: ee9ae91c-bcfe-4d97-93e9-95a5d9a7d96c {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:27 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Deleted allocations for instance e76e8a31-d8a3-4053-8a20-53fcccaacd82
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No VIF found with MAC fa:16:3e:d9:79:98, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7f7ed9c4-958d-48d6-a8cf-30e374faab3e tempest-DeleteServersTestJSON-1670689215 tempest-DeleteServersTestJSON-1670689215-project-member] Lock "e76e8a31-d8a3-4053-8a20-53fcccaacd82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.218s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:46:28 user nova-compute[87365]: INFO nova.compute.claims [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Claim successful on node user
Nov 08 13:46:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:29 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:46:29 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=6817MB free_disk=24.747482299804688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.941s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.407s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:46:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9743709b-872f-4248-bc61-b41122126030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5a8efc2a-3c53-4899-a716-7f193afe0e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance aa1308b7-4354-4938-a96f-663a78f096e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bff734c0-7eb2-4073-83e7-b60a1d0275d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:46:29 user nova-compute[87365]: INFO nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Booting with volume adfd1674-c9ea-419d-9e2d-f376eb8bb106 at /dev/vda
Nov 08 13:46:29 user nova-compute[87365]: DEBUG nova.policy [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55bd41d1019d482daeddf21aa8c4080e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc866ab8a5c04f8697b04aef5c329c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully created port: fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:46:30 user nova-compute[87365]: INFO nova.compute.claims [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Claim successful on node user
Nov 08 13:46:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully created port: 98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:46:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:46:31 user nova-compute[87365]: INFO nova.virt.block_device [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Booting with blank volume at /dev/vda
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.policy [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99bfb420b98c45d9b13589c4b2153fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f67a8efbc924527972b7f3a4fdac0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully created port: 34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Successfully created port: 2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updating instance_info_cache with network_info: [{"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-78bf22ef-27da-4b43-9da9-37de97525acc" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully created port: 10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Successfully updated port: 2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-changed-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Refreshing instance network info cache due to event network-changed-2f403498-6ab4-4d7e-bac9-ac06aef9a6db. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully created port: 2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance network_info: |[{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:32 user nova-compute[87365]: DEBUG nova.network.neutron [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Refreshing network info cache for port 2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updated VIF entry in instance network info cache for port 2f403498-6ab4-4d7e-bac9-ac06aef9a6db. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70b1d99c-8b5e-4e0c-826a-2ab708220d1f req-a223085e-4999-4d4f-b149-5f9e74f18c3f service nova] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-fa99f959-b5cf-4f15-9aec-60884cb6a997. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432a8312-86eb-4891-9ca8-aa6c8c859e3d req-0eb1ed84-c4aa-41e8-bc8f-f2e8fd70806c service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90ee4ce4-fe2a-4e49-92b3-7deb04c10836 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.832s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:34 user nova-compute[87365]: INFO nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Booting with volume 9ed40b9b-1b23-4fdf-8ed4-49095a352242 at /dev/vdc
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb748b1d-91bc-4d8e-94bd-0b44d59faf19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: INFO nova.compute.manager [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Detaching volume 25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3eaa88-b2ee-4bb6-9b52-1cbdc0550bf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ce96f-059f-4210-8528-0e043ce88d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef54e4-e3c5-4983-b3ca-d2a5807bded1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:34 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e986c645-e376-432f-a54b-33e46b41d0a9]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating existing volume attachment record: 65aaaa0f-60dd-479b-82c2-2d645a80e8ea {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c64ab-f4ee-413b-8526-8b75a16f1362]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1388fc3-7b15-4f59-9b88-c994ac571b72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: INFO nova.virt.block_device [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Attempting to driver detach volume 25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 from mountpoint /dev/sdc
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d97eb2b-f55b-4ffd-ba2c-0128908e0f39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[df20b971-99d4-4247-baba-5826fffda3ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Attempting to detach device sdc from instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:46:34 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:34 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:46:34 user nova-compute[87365]:   <target dev="sdc" bus="scsi"/>
Nov 08 13:46:34 user nova-compute[87365]:   <serial>25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4</serial>
Nov 08 13:46:34 user nova-compute[87365]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 13:46:34 user nova-compute[87365]: </disk>
Nov 08 13:46:34 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:34 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b96b91-0ccf-4950-98e4-c8da49b98400]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating existing volume attachment record: 6c567221-321d-4859-8168-7104e2384457 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:34 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Successfully detached device sdc from instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b from the persistent domain config.
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:46:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:46:34 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:34 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:46:34 user nova-compute[87365]:   <target dev="sdc" bus="scsi"/>
Nov 08 13:46:34 user nova-compute[87365]:   <serial>25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4</serial>
Nov 08 13:46:34 user nova-compute[87365]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 13:46:34 user nova-compute[87365]: </disk>
Nov 08 13:46:34 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: 12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: 98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-edbfd8ac-b523-4e52-9860-28d483b6fd29. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-12f689fe-2af5-4edb-a405-742859e76b3c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port 12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: 34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e4f3ee5d-398d-4f25-9cf8-2572f8d17feb req-060bf980-05a4-4278-b5d6-18cca1edc5bf service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: 10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-10643c61-1acb-4bcd-ace5-5b4b5204d871. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port 10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15fd2d4a-a979-468c-8af3-3e8c9ada970e req-07be3d87-7856-4165-9198-d4be62444c36 service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Successfully updated port: 2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-98b64a69-dc60-4118-89bc-2694600d9bbe. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:38 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:38 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:38 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[75528118-7569-4b13-bc33-400dba1b3abf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:46:38 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea456d1-2920-4a53-adcc-98f40c065310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f] added
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ad049-3bca-43e5-be56-57aa28c1f0a8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4b03c-7fc5-442c-96d4-15bdb521874d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnqcoSLW {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnqcoSLW" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[73544f42-8396-4816-b0b2-86b979808a34]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnqcoSLW'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d470901e-d482-4633-9355-c65b2f6852e3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c349f-b85f-44a0-9e90-4d4e19f8386a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff66b3-5bf6-4664-bf29-749573eca9ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]
Nov 08 13:46:38 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40f22b-4e8a-4f27-9e4e-315a3b38d401]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437490c-172e-4818-9f66-b15060967863]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:38 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-2ec10073-2ba4-4a46-84cb-c432b524b85b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9385291-ded0-4292-b4a0-479eabc83bc3]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance network_info: |[{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port 98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23465356630646366', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465356630646366', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.objects.instance [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lazy-loading 'flavor' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:46:40 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:40 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 13:46:40 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:46:40 user nova-compute[87365]:   <serial>bb7cee04-ba81-4e92-be4d-36db9206705f</serial>
Nov 08 13:46:40 user nova-compute[87365]: </disk>
Nov 08 13:46:40 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updated VIF entry in instance network info cache for port 98b64a69-dc60-4118-89bc-2694600d9bbe. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-34759ed9-3ca9-43ca-a427-f6202da5368a. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port 34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] No VIF found with MAC fa:16:3e:77:de:e9, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updated VIF entry in instance network info cache for port 34759ed9-3ca9-43ca-a427-f6202da5368a. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52cf489d-af34-4fba-b04f-39255d2ba6ac req-854d8789-569d-48db-904d-b8f87ca89c77 service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port 2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updated VIF entry in instance network info cache for port 2ec10073-2ba4-4a46-84cb-c432b524b85b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG nova.network.neutron [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-55fb214a-3f7a-4756-baf9-bf8966ec18ee req-4be64fbd-a409-4030-a11f-2607b7cd15d6 service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:46:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCPdIBbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:53 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:53 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:53 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f0f530-640a-4ce6-a9eb-366e2a72802e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:46:53 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[100a4ee6-9938-4644-b657-49d4ff86ef39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617] added
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[04482081-4ed2-4b92-b1a9-78543011c51a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7df00c-f55e-49c3-8c88-167be88358b4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCPdIBbH {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCPdIBbH" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b660013-95ae-48d7-92bc-cabe03f39dc7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCPdIBbH'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ed627-fa84-4bee-b2a5-cffd923bb974]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a04c68-94e6-4908-8e53-974d90eb2787]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a354de5-573c-4cea-b172-e3c8e70cafe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260]
Nov 08 13:46:53 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b1d767-f54e-4c17-8e69-6efcdd0c97e4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[64806d5b-73ec-4c42-951e-5c8229ed22c5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:53 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:46:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2468d-0592-48e2-b778-96391cf378fc]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCPdIBbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:46:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-db68c359-47f1-4743-bae7-7797a1098b5e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.412s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.utils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf32dd-95d7-4ae6-89b7-f0cccc9e4267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a320474f-8c9f-4053-a649-9be6aac4ee1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1b68d-0c47-4965-8746-f82767caf111]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e64de-3fb3-4b50-b53b-22129d32c95b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:46:54 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4aad6-b374-4ade-b939-74e3f47d7892]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.utils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating existing volume attachment record: 19dc3f06-4087-4bc1-93fc-06a200fe4280 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:54 user nova-compute[87365]: INFO nova.compute.manager [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Terminating instance
Nov 08 13:46:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26633653630623733', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633653630623733', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:46:54 user nova-compute[87365]: INFO nova.compute.manager [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Detaching volume 114d5710-7c6b-415e-be43-6735c8f85da2
Nov 08 13:46:54 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lazy-loading 'flavor' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 13:46:54 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:46:54 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:46:54 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:46:54 user nova-compute[87365]:   <serial>6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617</serial>
Nov 08 13:46:54 user nova-compute[87365]: </disk>
Nov 08 13:46:54 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-unplugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] No waiting events found dispatching network-vif-unplugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd9be816-70f1-415f-bf0f-84284d8f7700 req-5e02f9f4-af9a-492b-bd02-df4a44633b57 service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-unplugged-821ffb6c-e822-478c-9856-5bca62409400 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:46:55 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b is timed out.
Nov 08 13:46:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Successfully detached device sdc from instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b from the live domain config.
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZMicmns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:46:55 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[910420fc-182f-4f72-9d98-308d772a7de2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:46:55 user nova-compute[87365]: No targets found.
Nov 08 13:46:55 user nova-compute[87365]: iSNS:
Nov 08 13:46:55 user nova-compute[87365]: No targets found.
Nov 08 13:46:55 user nova-compute[87365]: STATIC:
Nov 08 13:46:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617
Nov 08 13:46:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2
Nov 08 13:46:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:46:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4
Nov 08 13:46:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:46:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:46:55 user nova-compute[87365]: FIRMWARE:
Nov 08 13:46:55 user nova-compute[87365]: No targets found.
Nov 08 13:46:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:46:55 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:46:55 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010b526-7ee4-4d3e-b134-a905f6536bae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5d6f0-51e3-4e9e-9582-dda12b86469c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:46:55 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:46:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf830e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] No VIF found with MAC fa:16:3e:6a:04:64, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779a43d-db0d-4dc9-9914-bcb9ceb71076]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5e5bd1-b5f2-470c-b8f5-505967ff58a3]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[58949bff-5e21-422c-a757-25049abc0216]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ada27a-da8b-4ba0-952d-38b10b52651d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce9d00-176b-46e9-bf41-193996f4130c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee9b087-faaa-478c-add4-83c6f62cfafd]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260]
Nov 08 13:46:55 user nova-compute[87365]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4, portal: 172.16.0.220,3260] successful.
Nov 08 13:46:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fcb9aa-271e-48fe-9a0c-c5bb5439d0a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940ab6e-fd2e-4b8f-9ec7-1a5a02d43ee2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] <== disconnect_volume: return (395ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:46:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Instance destroyed successfully.
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lazy-loading 'resources' on Instance uuid bff734c0-7eb2-4073-83e7-b60a1d0275d5 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1105886267',display_name='tempest-VolumesActionsTest-instance-1105886267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1105886267',id=11,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-ozrm4hye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:45:04Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=bff734c0-7eb2-4073-83e7-b60a1d0275d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "821ffb6c-e822-478c-9856-5bca62409400", "address": "fa:16:3e:77:cf:c2", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821ffb6c-e8", "ovs_interfaceid": "821ffb6c-e822-478c-9856-5bca62409400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG os_vif [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap821ffb6c-e8, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c8131b2-ed9f-4e84-9693-80961151051c) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:46:55 user nova-compute[87365]: INFO os_vif [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cf:c2,bridge_name='br-int',has_traffic_filtering=True,id=821ffb6c-e822-478c-9856-5bca62409400,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821ffb6c-e8')
Nov 08 13:46:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Deleting instance files /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5_del
Nov 08 13:46:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Deletion of /opt/stack/data/nova/instances/bff734c0-7eb2-4073-83e7-b60a1d0275d5_del complete
Nov 08 13:46:55 user nova-compute[87365]: INFO nova.compute.manager [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 08 13:46:55 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:46:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:56 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Took 0.59 seconds to deallocate network for instance.
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-575def0f-20ab-4f13-803b-7828d46963bf req-c576b5eb-7ed7-4ae2-bf14-f114d7362d2c service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-deleted-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:56 user nova-compute[87365]: INFO nova.compute.manager [req-575def0f-20ab-4f13-803b-7828d46963bf req-c576b5eb-7ed7-4ae2-bf14-f114d7362d2c service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Neutron deleted interface 821ffb6c-e822-478c-9856-5bca62409400; detaching it from the instance and deleting it from the info cache
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.network.neutron [req-575def0f-20ab-4f13-803b-7828d46963bf req-c576b5eb-7ed7-4ae2-bf14-f114d7362d2c service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-575def0f-20ab-4f13-803b-7828d46963bf req-c576b5eb-7ed7-4ae2-bf14-f114d7362d2c service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Detach interface failed, port_id=821ffb6c-e822-478c-9856-5bca62409400, reason: Instance bff734c0-7eb2-4073-83e7-b60a1d0275d5 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:46:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:56 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Deleted allocations for instance bff734c0-7eb2-4073-83e7-b60a1d0275d5
Nov 08 13:46:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b7338ca8-eb93-4f9d-934a-f1a1649d05f5 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:46:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] Acquiring lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:46:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:46:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] Lock "bff734c0-7eb2-4073-83e7-b60a1d0275d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:46:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] No waiting events found dispatching network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:46:57 user nova-compute[87365]: WARNING nova.compute.manager [req-a3e9606f-179e-4e99-9867-c40d86d23a9c req-ce64f192-bb97-4000-a6d6-d78731d736ef service nova] [instance: bff734c0-7eb2-4073-83e7-b60a1d0275d5] Received unexpected event network-vif-plugged-821ffb6c-e822-478c-9856-5bca62409400 for instance with vm_state deleted and task_state None.
Nov 08 13:47:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7c15b98e-4a0e-4c7a-a043-5e2e4db4692b tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.015s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lazy-loading 'flavor' on Instance uuid 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e7347b1-d651-4aa7-b0a3-28eae12c8a91 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.647s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:02 user nova-compute[87365]: INFO nova.virt.block_device [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Attempting to driver detach volume 114d5710-7c6b-415e-be43-6735c8f85da2 from mountpoint /dev/vdb
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Attempting to detach device vdb from instance 15d10a18-4260-481d-bdd8-ab3778293278 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:47:02 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:02 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:47:02 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:47:02 user nova-compute[87365]:   <serial>114d5710-7c6b-415e-be43-6735c8f85da2</serial>
Nov 08 13:47:02 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:47:02 user nova-compute[87365]: </disk>
Nov 08 13:47:02 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:47:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully detached device vdb from instance 15d10a18-4260-481d-bdd8-ab3778293278 from the persistent domain config.
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15d10a18-4260-481d-bdd8-ab3778293278 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:47:02 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:02 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:47:02 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:47:02 user nova-compute[87365]:   <serial>114d5710-7c6b-415e-be43-6735c8f85da2</serial>
Nov 08 13:47:02 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:47:02 user nova-compute[87365]: </disk>
Nov 08 13:47:02 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:47:02 user nova-compute[87365]: INFO nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Booting with volume 6f10e358-0661-4612-a6f1-6d9b2d55c82b at /dev/vdb
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b9ddc-a723-46a4-8618-485adcb37d74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a3a84d-01d6-4b01-bfe3-09bcdfa7060d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca0fdc-3622-447b-afdd-afc38abc706f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60dc40-6178-469d-9f4a-026f5d0df5c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] volume_snapshot_create: create_info: {'snapshot_id': '6cf0c19a-3312-4535-903a-88be04dd0ee9', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=87365) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:02 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b2094-3619-4a1c-bf4d-5044b8d6d175]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-31403bed-3125-4e3c-9a1b-229519523c87 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] volume_snapshot_delete: delete_info: {'volume_id': '6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617'} {{(pid=87365) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [None req-31403bed-3125-4e3c-9a1b-229519523c87 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     if delete_info['type'] != 'qcow2':
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] KeyError: 'type'
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] 
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating existing volume attachment record: 97023f43-dcbb-4ad0-a104-2754a2744ae5 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] snap xml: <domainsnapshot>
Nov 08 13:47:02 user nova-compute[87365]:   <disks>
Nov 08 13:47:02 user nova-compute[87365]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 08 13:47:02 user nova-compute[87365]:       <source file="/dev/new_file"/>
Nov 08 13:47:02 user nova-compute[87365]:     </disk>
Nov 08 13:47:02 user nova-compute[87365]:     <disk name="vda" snapshot="no"/>
Nov 08 13:47:02 user nova-compute[87365]:   </disks>
Nov 08 13:47:02 user nova-compute[87365]: </domainsnapshot>
Nov 08 13:47:02 user nova-compute[87365]:  {{(pid=87365) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] Lazy-loading 'system_metadata' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.utils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:02 user nova-compute[87365]: INFO nova.compute.manager [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Terminating instance
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a5606-55a3-4a10-86c9-628eb4c915e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a0560-0188-42ed-a3a8-6f78c2a2d13e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [None req-31403bed-3125-4e3c-9a1b-229519523c87 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-0849967e-c431-47b2-96fe-9b384bae9801)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f090b5-a639-478e-a10e-9b5ac450b74a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7038113-e186-4b55-b270-2738ce4df0ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:47:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 13:47:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-31403bed-3125-4e3c-9a1b-229519523c87 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] Exception during message handling: KeyError: 'type'
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 13:47:02 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:02 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:47:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d20f72-0143-4131-a138-3e7230e46326]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     rv = execute(f, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     six.reraise(c, e, tb)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     raise value
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     rv = meth(*args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] 
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] [instance: 9743709b-872f-4248-bc61-b41122126030] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] Traceback (most recent call last):
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     self._volume_snapshot_create(context, instance, guest,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     rv = execute(f, *args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     six.reraise(c, e, tb)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     raise value
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     rv = meth(*args, **kwargs)
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:02 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [instance: 9743709b-872f-4248-bc61-b41122126030] 
Nov 08 13:47:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG os_brick.utils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-unplugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] No waiting events found dispatching network-vif-unplugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-a789aedc-9c81-4d76-b3a0-79ae599e64b0 req-00a54288-33ca-43ff-8e59-fd7eacbf9527 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-unplugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:47:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Instance destroyed successfully.
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lazy-loading 'resources' on Instance uuid 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1542475031',display_name='tempest-AttachSCSIVolumeTestJSON-server-1542475031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1542475031',id=8,image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDLwCMfMEnmdOVE6lFDBRj42EK+qEL9ECL/YcQeSWrwWHa/TeaLW6xbo459Mb03vhQfivHSyh69Bi/13wC4nkchENJtf67IZvKfMk1JDR+DeCQT1J8hQq+pqBLBmgPvw==',key_name='tempest-keypair-38496071',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:44:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b718b33ef834685a4d7bd419c4227d2',ramdisk_id='',reservation_id='r-v16bxkdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69f69d92-9c62-4a5c-b71a-89140a6e7b5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-667266669',owner_user_name='tempest-AttachSCSIVolumeTestJSON-667266669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86f57e177fdc404b976e02ea6d975980',uuid=5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converting VIF {"id": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "address": "fa:16:3e:68:b1:47", "network": {"id": "b07474ef-ad08-4599-a3c9-de0dd6129781", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1324200551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b718b33ef834685a4d7bd419c4227d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce489c81-8b", "ovs_interfaceid": "ce489c81-8bbf-45eb-b1bf-1cc7da2a2023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG os_vif [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce489c81-8b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10f3ddcc-2a00-4bed-8e22-91db798f530c) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:03 user nova-compute[87365]: INFO os_vif [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b1:47,bridge_name='br-int',has_traffic_filtering=True,id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023,network=Network(b07474ef-ad08-4599-a3c9-de0dd6129781),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce489c81-8b')
Nov 08 13:47:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Deleting instance files /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b_del
Nov 08 13:47:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Deletion of /opt/stack/data/nova/instances/5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b_del complete
Nov 08 13:47:03 user nova-compute[87365]: INFO nova.compute.manager [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 13:47:03 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:47:03 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:47:04 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:04 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Took 0.94 seconds to deallocate network for instance.
Nov 08 13:47:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-85d498c4-8ce8-4d25-b5be-48658d95c9dd req-9f3375de-7dde-4c6c-bfff-ca76a52a3deb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-deleted-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:04 user nova-compute[87365]: INFO nova.compute.manager [req-85d498c4-8ce8-4d25-b5be-48658d95c9dd req-9f3375de-7dde-4c6c-bfff-ca76a52a3deb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Neutron deleted interface ce489c81-8bbf-45eb-b1bf-1cc7da2a2023; detaching it from the instance and deleting it from the info cache
Nov 08 13:47:04 user nova-compute[87365]: DEBUG nova.network.neutron [req-85d498c4-8ce8-4d25-b5be-48658d95c9dd req-9f3375de-7dde-4c6c-bfff-ca76a52a3deb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-85d498c4-8ce8-4d25-b5be-48658d95c9dd req-9f3375de-7dde-4c6c-bfff-ca76a52a3deb service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Detach interface failed, port_id=ce489c81-8bbf-45eb-b1bf-1cc7da2a2023, reason: Instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:47:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:05 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Deleted allocations for instance 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8dce720f-770b-402d-9cec-92a993b1a3c6 tempest-AttachSCSIVolumeTestJSON-667266669 tempest-AttachSCSIVolumeTestJSON-667266669-project-member] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.449s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] Acquiring lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] Lock "5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] No waiting events found dispatching network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:05 user nova-compute[87365]: WARNING nova.compute.manager [req-5de81021-7de9-486b-b193-2e2d5ed47fb4 req-aef3ad1c-0e9f-45b3-ada4-d0c86817d728 service nova] [instance: 5a56e65e-ff21-4f07-9b7e-b2ff41f6f24b] Received unexpected event network-vif-plugged-ce489c81-8bbf-45eb-b1bf-1cc7da2a2023 for instance with vm_state deleted and task_state None.
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6cf0c19a-3312-4535-903a-88be04dd0ee9 could not be found.
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6cf0c19a-3312-4535-903a-88be04dd0ee9 could not be found. (HTTP 404) (Request-ID: req-dd71bfa4-9007-4fbe-a8f0-9f59791abc86)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6cf0c19a-3312-4535-903a-88be04dd0ee9 could not be found.
Nov 08 13:47:05 user nova-compute[87365]: ERROR nova.virt.libvirt.driver 
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-1a13bc2b-9d0a-4127-a1eb-c6cb0ceb1200 tempest-VolumesAssistedSnapshotsTest-909028751 tempest-VolumesAssistedSnapshotsTest-909028751-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 13:47:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "9743709b-872f-4248-bc61-b41122126030" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:05 user nova-compute[87365]: INFO nova.compute.manager [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Swapping volume bb7cee04-ba81-4e92-be4d-36db9206705f for 4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:47:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Creating image(s)
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Ensure instance console log exists: /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Start _get_guest_xml network_info=[{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcAYNWkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa1308b7-4354-4938-a96f-663a78f096e5', 'attached_at': '', 'detached_at': '', 'volume_id': '36cc0e21-f366-44e8-92d5-3bee25be6ffd', 'serial': '36cc0e21-f366-44e8-92d5-3bee25be6ffd'}, 'attachment_id': '3361de69-92e1-4994-83a1-f55e0345913d', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMbxTpDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa1308b7-4354-4938-a96f-663a78f096e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1ddeaa8-d88a-455d-8cb4-37f75861b495', 'serial': 'c1ddeaa8-d88a-455d-8cb4-37f75861b495'}, 'attachment_id': '1c7fd631-5f12-40c5-b68e-0fc56c79bc0d', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIQjRsnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa1308b7-4354-4938-a96f-663a78f096e5', 'attached_at': '', 'detached_at': '', 'volume_id': '9ed40b9b-1b23-4fdf-8ed4-49095a352242', 'serial': '9ed40b9b-1b23-4fdf-8ed4-49095a352242'}, 'attachment_id': '6c567221-321d-4859-8168-7104e2384457', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:47:05 user nova-compute[87365]: INFO nova.compute.manager [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Detaching volume 6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617
Nov 08 13:47:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcAYNWkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:05 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:05 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:05 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1e4de-fcff-4af8-9a7f-9489cb670f4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:47:05 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[084c4a3e-cbab-4a77-a452-c726677a6fe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd] added
Nov 08 13:47:05 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f8272-551b-4c3f-aee8-0f51330bf57e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7905864-f337-4033-97e6-52068bfd7d42]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcAYNWkR {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcAYNWkR" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59a0229-b6b3-4005-bc6d-c597ef29aeff]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcAYNWkR'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a79912-7375-4e56-82d3-ada829e5bad1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778691a-e11e-4f36-884a-30d1ea85c0a8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:05 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:05 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:05 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:05 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:05 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:05 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c0d8e3-c588-45e4-9612-d2b19a62d2dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260]
Nov 08 13:47:06 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee9d150-7f63-461b-8df5-49304ab78daa]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0278d149-d6f0-464e-ac93-a0f1750f6609]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:06 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[17957796-cde6-4717-9942-aefdd4eb2ce4]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:06 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcAYNWkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23431343134396438', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343134396438', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMbxTpDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:07 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:07 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:07 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef050fca-9dfd-44fa-99e5-cef4a6bb0849]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:47:07 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b15245-2a14-4fbb-8f46-d95337a41e5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495] added
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eeca97-f90d-4b91-9f01-639cef8c3415]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770ad12-58d8-4bbc-8ede-dad7f1e20e88]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMbxTpDr {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMbxTpDr" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e18c8-bd3f-44de-9d39-1e620ad7edba]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMbxTpDr'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef80b5d-15ec-4b58-a1f9-bf8bf97011d9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d4420-2f96-4326-8275-40b69e87ca3e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c82668e-714a-40cf-ac0d-69540af9130b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260]
Nov 08 13:47:07 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f66280-ece0-4bc8-8b06-ff5d59737f5e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beaa151-29c2-4bf0-ad78-1471167d5c8a]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:07 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d54ce-d754-40d5-8448-bb44072a9cee]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMbxTpDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23235633132393939', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235633132393939', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIQjRsnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:08 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:08 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:08 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a787b18-9718-451e-9f9d-e7c6dfd3d6dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:47:08 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2922f0-85ec-4b72-a526-eb8c05b74084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242] added
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73af2f7-6196-4dc7-90dd-169344c6bb47]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dabdd75-5810-4c22-927d-6de04788b9d4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIQjRsnJ {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIQjRsnJ" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18ef4f-a603-4c4d-866b-e594ad1af1d3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIQjRsnJ'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc97f8d5-bf87-4740-8973-91a5f667981f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493601f-1af8-444f-9ea4-914cf4fb9eab]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8cf17-af00-4646-b4ed-f9fe0c2779eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260]
Nov 08 13:47:08 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce0565-bd39-4e3b-8c2a-3e8878de83f0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[44efc068-8a6d-4df0-a3c1-28a41c3d2f2e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15500f2-2e87-44cf-aefe-7aec123bdaf5]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIQjRsnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26364383266663137', 'path': '/dev/sdg'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364383266663137', 'path': '/dev/sdg'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lazy-loading 'pci_devices' on Instance uuid aa1308b7-4354-4938-a96f-663a78f096e5 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:47:09 user nova-compute[87365]:   <uuid>aa1308b7-4354-4938-a96f-663a78f096e5</uuid>
Nov 08 13:47:09 user nova-compute[87365]:   <name>instance-0000000d</name>
Nov 08 13:47:09 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:47:09 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:47:09 user nova-compute[87365]:   <metadata>
Nov 08 13:47:09 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:47:09 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:name>tempest-device-tagging-server-2101620831</nova:name>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:47:05</nova:creationTime>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:47:09 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:47:09 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:owner>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:user uuid="14a50a4f5253401dbb4647133d73ecca">tempest-TaggedBootDevicesTest-966933490-project-member</nova:user>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:project uuid="d2e921e38cdc46f6b9e82be020e4c982">tempest-TaggedBootDevicesTest-966933490</nova:project>
Nov 08 13:47:09 user nova-compute[87365]:       </nova:owner>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:47:09 user nova-compute[87365]:       <nova:ports>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="7bd652d1-1c41-4309-b3b1-658c10d9cf0d">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="f0d1ec9d-444c-48c8-8037-97b39a953724">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="6ea3bd8d-376e-4192-9cc6-d9548af4d496">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="8d3d170e-87b7-4968-a83b-38a3a9a0c232">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="6b4e8509-7c27-40e9-a9b8-30a9d94adff8">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:         <nova:port uuid="18a6839a-9731-4d8d-8e7d-48656f5983d4">
Nov 08 13:47:09 user nova-compute[87365]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 13:47:09 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:09 user nova-compute[87365]:       </nova:ports>
Nov 08 13:47:09 user nova-compute[87365]:     </nova:instance>
Nov 08 13:47:09 user nova-compute[87365]:   </metadata>
Nov 08 13:47:09 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:47:09 user nova-compute[87365]:     <system>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="serial">aa1308b7-4354-4938-a96f-663a78f096e5</entry>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="uuid">aa1308b7-4354-4938-a96f-663a78f096e5</entry>
Nov 08 13:47:09 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:47:09 user nova-compute[87365]:     </system>
Nov 08 13:47:09 user nova-compute[87365]:   </sysinfo>
Nov 08 13:47:09 user nova-compute[87365]:   <os>
Nov 08 13:47:09 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:47:09 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:47:09 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:47:09 user nova-compute[87365]:   </os>
Nov 08 13:47:09 user nova-compute[87365]:   <features>
Nov 08 13:47:09 user nova-compute[87365]:     <acpi/>
Nov 08 13:47:09 user nova-compute[87365]:     <apic/>
Nov 08 13:47:09 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:47:09 user nova-compute[87365]:   </features>
Nov 08 13:47:09 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:47:09 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:47:09 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:47:09 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:47:09 user nova-compute[87365]:   </clock>
Nov 08 13:47:09 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:47:09 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:47:09 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:47:09 user nova-compute[87365]:   </cpu>
Nov 08 13:47:09 user nova-compute[87365]:   <devices>
Nov 08 13:47:09 user nova-compute[87365]:     <disk type="file" device="cdrom">
Nov 08 13:47:09 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 13:47:09 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/disk.config"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="hda" bus="ide"/>
Nov 08 13:47:09 user nova-compute[87365]:     </disk>
Nov 08 13:47:09 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:47:09 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:09 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <serial>36cc0e21-f366-44e8-92d5-3bee25be6ffd</serial>
Nov 08 13:47:09 user nova-compute[87365]:     </disk>
Nov 08 13:47:09 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:47:09 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:09 user nova-compute[87365]:       <source dev="/dev/sdf"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <serial>c1ddeaa8-d88a-455d-8cb4-37f75861b495</serial>
Nov 08 13:47:09 user nova-compute[87365]:     </disk>
Nov 08 13:47:09 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:47:09 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:09 user nova-compute[87365]:       <source dev="/dev/sdg"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="vdc" bus="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <serial>9ed40b9b-1b23-4fdf-8ed4-49095a352242</serial>
Nov 08 13:47:09 user nova-compute[87365]:     </disk>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:fc:f1:c9"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tap7bd652d1-1c"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:9a:bb:bc"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tapf0d1ec9d-44"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:0d:75:e6"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tap6ea3bd8d-37"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:b0:35:ac"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tap8d3d170e-87"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:2b:5d:ee"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tapc7d0482a-c0"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:2d:38:ee"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tap6b4e8509-7c"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:09 user nova-compute[87365]:       <mac address="fa:16:3e:74:77:c9"/>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:09 user nova-compute[87365]:       <target dev="tap18a6839a-97"/>
Nov 08 13:47:09 user nova-compute[87365]:     </interface>
Nov 08 13:47:09 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:47:09 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/console.log" append="off"/>
Nov 08 13:47:09 user nova-compute[87365]:     </serial>
Nov 08 13:47:09 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:47:09 user nova-compute[87365]:     <video>
Nov 08 13:47:09 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:09 user nova-compute[87365]:     </video>
Nov 08 13:47:09 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:47:09 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:47:09 user nova-compute[87365]:     </rng>
Nov 08 13:47:09 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:47:09 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:47:09 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:47:09 user nova-compute[87365]:     </memballoon>
Nov 08 13:47:09 user nova-compute[87365]:   </devices>
Nov 08 13:47:09 user nova-compute[87365]: </domain>
Nov 08 13:47:09 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f07c010-63b0-5e21-9de6-ea0466e2378f', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bd652d1-1c, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bd652d1-1c, col_values=(('qos', UUID('d1aa2275-4a2f-4ea8-aabf-5ffce7151ec5')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bd652d1-1c, col_values=(('external_ids', {'iface-id': '7bd652d1-1c41-4309-b3b1-658c10d9cf0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f1:c9', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c')
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2055003e-1c40-5085-a485-951c5c23be46', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0d1ec9d-44, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0d1ec9d-44, col_values=(('qos', UUID('119dee71-5d16-4da0-a21d-86b1fc8075f4')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0d1ec9d-44, col_values=(('external_ids', {'iface-id': 'f0d1ec9d-444c-48c8-8037-97b39a953724', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:bb:bc', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44')
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1399313-2944-54cf-967f-10931c7d0dde', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ea3bd8d-37, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ea3bd8d-37, col_values=(('qos', UUID('e483c19e-db52-4c38-b56b-bfbe18cd877f')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ea3bd8d-37, col_values=(('external_ids', {'iface-id': '6ea3bd8d-376e-4192-9cc6-d9548af4d496', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:75:e6', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37')
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34dac00c-0572-571c-8bba-8d4f04850ad5', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d3d170e-87, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d3d170e-87, col_values=(('qos', UUID('f1224cb6-971e-4324-ac63-d1d74a391f43')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d3d170e-87, col_values=(('external_ids', {'iface-id': '8d3d170e-87b7-4968-a83b-38a3a9a0c232', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:35:ac', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87')
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85d81ba4-5d13-5e67-b6fa-026bce89927b', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7d0482a-c0, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7d0482a-c0, col_values=(('qos', UUID('12a64ff0-aa55-4ea4-9bbe-26c6670f273b')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7d0482a-c0, col_values=(('external_ids', {'iface-id': 'c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:5d:ee', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0')
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba7b7d2f-18c3-5d5a-abb9-5786c588dfef', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4e8509-7c, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b4e8509-7c, col_values=(('qos', UUID('6aba8e05-703d-4cff-9675-a9d5ce8630ff')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b4e8509-7c, col_values=(('external_ids', {'iface-id': '6b4e8509-7c27-40e9-a9b8-30a9d94adff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:38:ee', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c')
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e85250df-8cb0-543a-88a7-cce8e8ab2837', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a6839a-97, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18a6839a-97, col_values=(('qos', UUID('2592bff4-4e0a-42c0-8f68-e45917546b12')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18a6839a-97, col_values=(('external_ids', {'iface-id': '18a6839a-9731-4d8d-8e7d-48656f5983d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:77:c9', 'vm-uuid': 'aa1308b7-4354-4938-a96f-663a78f096e5'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:10 user nova-compute[87365]: INFO os_vif [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97')
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] No BDM found with device name hda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] No VIF found with MAC fa:16:3e:fc:f1:c9, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] No VIF found with MAC fa:16:3e:2b:5d:ee, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:10 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Using config drive
Nov 08 13:47:10 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Creating config drive at /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/disk.config
Nov 08 13:47:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2j9jggn6 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2j9jggn6" returned: 0 in 0.093s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:11 user nova-compute[87365]: INFO nova.compute.manager [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Terminating instance
Nov 08 13:47:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:47:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-unplugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] No waiting events found dispatching network-vif-unplugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-ac33e2fc-6d2b-4a95-a3a5-26c25893ce04 req-16938440-83b5-47bf-8e4c-71d066882562 service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-unplugged-558b65ae-5164-4258-bc81-eb482dbbb19b for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:12 user nova-compute[87365]: WARNING nova.compute.manager [req-ec0ed73f-5ae0-4121-8fca-529cf1d285e8 req-7d5d9538-5418-4b05-ab21-54b4e211dad8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d for instance with vm_state building and task_state spawning.
Nov 08 13:47:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Instance destroyed successfully.
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.objects.instance [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lazy-loading 'resources' on Instance uuid 5a8efc2a-3c53-4899-a716-7f193afe0e1c {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-56811682',display_name='tempest-ServersNegativeTestJSON-server-56811682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-56811682',id=12,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-1irb3nj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:45:31Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=5a8efc2a-3c53-4899-a716-7f193afe0e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "558b65ae-5164-4258-bc81-eb482dbbb19b", "address": "fa:16:3e:b1:72:15", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap558b65ae-51", "ovs_interfaceid": "558b65ae-5164-4258-bc81-eb482dbbb19b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG os_vif [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap558b65ae-51, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e70538b-dd47-4396-b852-714550b79e02) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: INFO os_vif [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:72:15,bridge_name='br-int',has_traffic_filtering=True,id=558b65ae-5164-4258-bc81-eb482dbbb19b,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap558b65ae-51')
Nov 08 13:47:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Deleting instance files /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c_del
Nov 08 13:47:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Deletion of /opt/stack/data/nova/instances/5a8efc2a-3c53-4899-a716-7f193afe0e1c_del complete
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: INFO nova.compute.manager [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 08 13:47:13 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:14 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Took 0.94 seconds to deallocate network for instance.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Acquiring lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] No waiting events found dispatching network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received unexpected event network-vif-plugged-558b65ae-5164-4258-bc81-eb482dbbb19b for instance with vm_state active and task_state deleting.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-682848e8-06b0-411f-9e72-ecd14b196b51 req-e80d0328-0035-4b4d-9035-cb8a81e0eafd service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: 5a8efc2a-3c53-4899-a716-7f193afe0e1c] Received event network-vif-deleted-558b65ae-5164-4258-bc81-eb482dbbb19b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:14 user nova-compute[87365]: WARNING nova.compute.manager [req-cef2276e-03a2-42a3-afb8-ea8cc96a04f1 req-ca5d6dd8-1c92-4cb0-b981-3e7ad6b36a7b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde for instance with vm_state building and task_state spawning.
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:14 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Deleted allocations for instance 5a8efc2a-3c53-4899-a716-7f193afe0e1c
Nov 08 13:47:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-84195343-7043-4604-8652-96a4fc0e8ba2 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "5a8efc2a-3c53-4899-a716-7f193afe0e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.188s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:16 user nova-compute[87365]: WARNING nova.compute.manager [req-154310d8-c092-419a-942e-b57420ea1544 req-51b24d1b-d890-42bc-9a40-cb9ff9c488f8 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 for instance with vm_state building and task_state spawning.
Nov 08 13:47:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:16 user nova-compute[87365]: WARNING nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 for instance with vm_state building and task_state spawning.
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:16 user nova-compute[87365]: WARNING nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 for instance with vm_state building and task_state spawning.
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:16 user nova-compute[87365]: WARNING nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 for instance with vm_state building and task_state spawning.
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:16 user nova-compute[87365]: WARNING nova.compute.manager [req-15f4877d-8ae7-470e-8024-e8076dc93af0 req-a770a709-79a5-4427-9315-50f0d6bdb83b service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 for instance with vm_state building and task_state spawning.
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:47:17 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance spawned successfully.
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:17 user nova-compute[87365]: INFO nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Took 11.55 seconds to spawn the instance on the hypervisor.
Nov 08 13:47:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:47:17 user nova-compute[87365]: INFO nova.compute.manager [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Took 95.12 seconds to build instance.
Nov 08 13:47:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b8a8cf2-b004-4455-a1fb-21c1812437ed tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 95.242s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:22 user nova-compute[87365]: INFO nova.virt.block_device [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Attempting to driver detach volume 6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 from mountpoint /dev/vdb
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Attempting to detach device vdb from instance 9743709b-872f-4248-bc61-b41122126030 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 13:47:22 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:22 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:47:22 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:47:22 user nova-compute[87365]:   <serial>6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617</serial>
Nov 08 13:47:22 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:47:22 user nova-compute[87365]: </disk>
Nov 08 13:47:22 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:47:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Successfully detached device vdb from instance 9743709b-872f-4248-bc61-b41122126030 from the persistent domain config.
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9743709b-872f-4248-bc61-b41122126030 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 13:47:22 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:22 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:47:22 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:47:22 user nova-compute[87365]:   <serial>6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617</serial>
Nov 08 13:47:22 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:47:22 user nova-compute[87365]: </disk>
Nov 08 13:47:22 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:47:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Creating image(s)
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Ensure instance console log exists: /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start _get_guest_xml network_info=[{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '368e18ac-eebe-44e9-a2e2-e7059dd82243', 'attached_at': '', 'detached_at': '', 'volume_id': '06a464b2-b817-4838-b7ae-a029d6a2b60e', 'serial': '06a464b2-b817-4838-b7ae-a029d6a2b60e'}, 'attachment_id': '19dc3f06-4087-4bc1-93fc-06a200fe4280', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:47:22 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:22 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:22 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:22 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:22 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0a781-2243-4335-a23e-8663aa6599d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:47:22 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 15d10a18-4260-481d-bdd8-ab3778293278 is timed out.
Nov 08 13:47:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully detached device vdb from instance 15d10a18-4260-481d-bdd8-ab3778293278 from the live domain config.
Nov 08 13:47:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ziklmJEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:22 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9006899-e4aa-44fe-8f5e-63335764c5fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e] added
Nov 08 13:47:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef5f6f7-da77-48a1-a27b-161ac98119a7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d02f4-d1d2-436f-b6c3-6294242b5ac7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgknSalT {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgknSalT" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75206b4-2c44-452d-a7c6-eb335af5cf8c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UgknSalT'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[01859462-2934-4b6c-8ce0-e59b2fb3dfbf]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75089ca-4d43-48f4-81ac-764942e7e6e4]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f423873b-225d-4a47-a3bb-52c6efaffcb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260]
Nov 08 13:47:23 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e366d-bc2f-4c27-8b1b-c560bce77b11]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7caf3-7f6f-4949-ac8c-074e00271f0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f1441b-ca8b-4cfc-ba4d-bddd1c5f6e15]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23665643533306137', 'path': '/dev/sdh'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665643533306137', 'path': '/dev/sdh'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.362s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e1840-ef69-4d6d-b0a3-bc5629b30f5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:47:24 user nova-compute[87365]: No targets found.
Nov 08 13:47:24 user nova-compute[87365]: iSNS:
Nov 08 13:47:24 user nova-compute[87365]: No targets found.
Nov 08 13:47:24 user nova-compute[87365]: STATIC:
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:47:24 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:24 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:24 user nova-compute[87365]: FIRMWARE:
Nov 08 13:47:24 user nova-compute[87365]: No targets found.
Nov 08 13:47:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:47:24 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:47:24 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1917528633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1917528633',id=15,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-0sqwha4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:31Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=368e18ac-eebe-44e9-a2e2-e7059dd82243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:47:24 user nova-compute[87365]:   <uuid>368e18ac-eebe-44e9-a2e2-e7059dd82243</uuid>
Nov 08 13:47:24 user nova-compute[87365]:   <name>instance-0000000f</name>
Nov 08 13:47:24 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:47:24 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:47:24 user nova-compute[87365]:   <metadata>
Nov 08 13:47:24 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:47:24 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1917528633</nova:name>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:47:22</nova:creationTime>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:47:24 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:47:24 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:owner>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:47:24 user nova-compute[87365]:       </nova:owner>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:47:24 user nova-compute[87365]:       <nova:ports>
Nov 08 13:47:24 user nova-compute[87365]:         <nova:port uuid="2f403498-6ab4-4d7e-bac9-ac06aef9a6db">
Nov 08 13:47:24 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 13:47:24 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:24 user nova-compute[87365]:       </nova:ports>
Nov 08 13:47:24 user nova-compute[87365]:     </nova:instance>
Nov 08 13:47:24 user nova-compute[87365]:   </metadata>
Nov 08 13:47:24 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:47:24 user nova-compute[87365]:     <system>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="serial">368e18ac-eebe-44e9-a2e2-e7059dd82243</entry>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="uuid">368e18ac-eebe-44e9-a2e2-e7059dd82243</entry>
Nov 08 13:47:24 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:47:24 user nova-compute[87365]:     </system>
Nov 08 13:47:24 user nova-compute[87365]:   </sysinfo>
Nov 08 13:47:24 user nova-compute[87365]:   <os>
Nov 08 13:47:24 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:47:24 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:47:24 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:47:24 user nova-compute[87365]:   </os>
Nov 08 13:47:24 user nova-compute[87365]:   <features>
Nov 08 13:47:24 user nova-compute[87365]:     <acpi/>
Nov 08 13:47:24 user nova-compute[87365]:     <apic/>
Nov 08 13:47:24 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:47:24 user nova-compute[87365]:   </features>
Nov 08 13:47:24 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:47:24 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:47:24 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:47:24 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:47:24 user nova-compute[87365]:   </clock>
Nov 08 13:47:24 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:47:24 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:47:24 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:47:24 user nova-compute[87365]:   </cpu>
Nov 08 13:47:24 user nova-compute[87365]:   <devices>
Nov 08 13:47:24 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:47:24 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:47:24 user nova-compute[87365]:       <source dev="/dev/sdh"/>
Nov 08 13:47:24 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:47:24 user nova-compute[87365]:       <serial>06a464b2-b817-4838-b7ae-a029d6a2b60e</serial>
Nov 08 13:47:24 user nova-compute[87365]:     </disk>
Nov 08 13:47:24 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:24 user nova-compute[87365]:       <mac address="fa:16:3e:2b:0f:e0"/>
Nov 08 13:47:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:24 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:24 user nova-compute[87365]:       <target dev="tap2f403498-6a"/>
Nov 08 13:47:24 user nova-compute[87365]:     </interface>
Nov 08 13:47:24 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:47:24 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/console.log" append="off"/>
Nov 08 13:47:24 user nova-compute[87365]:     </serial>
Nov 08 13:47:24 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:47:24 user nova-compute[87365]:     <video>
Nov 08 13:47:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:24 user nova-compute[87365]:     </video>
Nov 08 13:47:24 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:47:24 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:47:24 user nova-compute[87365]:     </rng>
Nov 08 13:47:24 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:47:24 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:47:24 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:47:24 user nova-compute[87365]:     </memballoon>
Nov 08 13:47:24 user nova-compute[87365]:   </devices>
Nov 08 13:47:24 user nova-compute[87365]: </domain>
Nov 08 13:47:24 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1917528633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1917528633',id=15,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-0sqwha4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:31Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=368e18ac-eebe-44e9-a2e2-e7059dd82243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_vif [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc442f-0d7a-4d4a-9761-4cb1db9cdab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fc5a339-ca05-521a-b713-d10eb6d817ed', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f403498-6a, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f403498-6a, col_values=(('qos', UUID('fe93eb47-cf99-4289-ba82-5bf514b04427')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f403498-6a, col_values=(('external_ids', {'iface-id': '2f403498-6ab4-4d7e-bac9-ac06aef9a6db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:0f:e0', 'vm-uuid': '368e18ac-eebe-44e9-a2e2-e7059dd82243'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f167122-ff41-489a-8f64-ace70a1bcad6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d25f21f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:24 user nova-compute[87365]: INFO os_vif [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a')
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97add0e-2314-4cbd-badb-89c4bdfbe957]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f661c7-5ba5-4caa-8e40-daf37c720d7b]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1745a-e5bf-4c05-a8da-977390aafc24]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:2b:0f:e0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d013dd4-6219-4d1c-a862-22a8bbce9047]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc31a97-a45a-4c52-897e-262f6a24feb0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc5eccb-703b-4a91-b01b-146ae6da50c8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260]
Nov 08 13:47:24 user nova-compute[87365]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114d5710-7c6b-415e-be43-6735c8f85da2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9856cb-5940-4c24-aa65-baf8ef83fa2a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] <== disconnect_volume: return (1779ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:24 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'flavor' on Instance uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6c4fb15a-2227-45ad-8b61-1dca8b951317 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.950s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:25 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:47:25 user nova-compute[87365]: INFO nova.compute.claims [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Claim successful on node user
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:26 user nova-compute[87365]: WARNING nova.compute.manager [req-10e85fb6-42b7-48cf-be98-f78ea9f035c5 req-18347905-3940-494c-ba30-e90477ed53d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state building and task_state spawning.
Nov 08 13:47:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:47:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.policy [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33521b67405a405f912d0879b3d77829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a890ce53c34008a7a872f409fe4550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:47:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Creating image(s)
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "/opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "/opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Successfully created port: 8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk 1073741824" returned: 0 in 0.052s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Cannot resize image /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Successfully updated port: 8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-changed-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Refreshing instance network info cache due to event network-changed-8487e943-4746-43ff-93db-f364699a6d3c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:47:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] Acquiring lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:28 user nova-compute[87365]: WARNING nova.compute.manager [req-472a83be-dfdf-4714-8a64-578066384bfe req-255c6355-8702-4536-b700-576df5c600b9 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state building and task_state spawning.
Nov 08 13:47:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance spawned successfully.
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:28 user nova-compute[87365]: INFO nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance network_info: |[{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] Acquired lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Refreshing network info cache for port 8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Start _get_guest_xml network_info=[{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:47:28 user nova-compute[87365]: INFO nova.compute.manager [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Took 58.03 seconds to build instance.
Nov 08 13:47:28 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:28 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6fa4cd11-bfa7-4b09-bd70-f1f597c4adb7 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.189s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-978346557',display_name='tempest-tempest.common.compute-instance-978346557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-978346557',id=16,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXssOCN6l/BHRW8eYhwE/+KFpIm6yZAz+7PkYmeevUzCp4InPVQp+u9pz8vhJDmHM4iGSRQguFaolJQxr0wTymCCCouBr7rmsCpZbHhdxLPc17+hEnzAvYx6PBQWGBzRQ==',key_name='tempest-keypair-1114508957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-vdqtxa2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=7f48b991-bd55-400d-ac6a-5ed4f976b6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:47:28 user nova-compute[87365]:   <uuid>7f48b991-bd55-400d-ac6a-5ed4f976b6a0</uuid>
Nov 08 13:47:28 user nova-compute[87365]:   <name>instance-00000010</name>
Nov 08 13:47:28 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:47:28 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:47:28 user nova-compute[87365]:   <metadata>
Nov 08 13:47:28 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:47:28 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:name>tempest-tempest.common.compute-instance-978346557</nova:name>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:47:28</nova:creationTime>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:47:28 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:47:28 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:owner>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:user uuid="33521b67405a405f912d0879b3d77829">tempest-ServerActionsTestOtherA-777028083-project-member</nova:user>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:project uuid="90a890ce53c34008a7a872f409fe4550">tempest-ServerActionsTestOtherA-777028083</nova:project>
Nov 08 13:47:28 user nova-compute[87365]:       </nova:owner>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:47:28 user nova-compute[87365]:       <nova:ports>
Nov 08 13:47:28 user nova-compute[87365]:         <nova:port uuid="8487e943-4746-43ff-93db-f364699a6d3c">
Nov 08 13:47:28 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 13:47:28 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:28 user nova-compute[87365]:       </nova:ports>
Nov 08 13:47:28 user nova-compute[87365]:     </nova:instance>
Nov 08 13:47:28 user nova-compute[87365]:   </metadata>
Nov 08 13:47:28 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:47:28 user nova-compute[87365]:     <system>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="serial">7f48b991-bd55-400d-ac6a-5ed4f976b6a0</entry>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="uuid">7f48b991-bd55-400d-ac6a-5ed4f976b6a0</entry>
Nov 08 13:47:28 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:47:28 user nova-compute[87365]:     </system>
Nov 08 13:47:28 user nova-compute[87365]:   </sysinfo>
Nov 08 13:47:28 user nova-compute[87365]:   <os>
Nov 08 13:47:28 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:47:28 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:47:28 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:47:28 user nova-compute[87365]:   </os>
Nov 08 13:47:28 user nova-compute[87365]:   <features>
Nov 08 13:47:28 user nova-compute[87365]:     <acpi/>
Nov 08 13:47:28 user nova-compute[87365]:     <apic/>
Nov 08 13:47:28 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:47:28 user nova-compute[87365]:   </features>
Nov 08 13:47:28 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:47:28 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:47:28 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:47:28 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:47:28 user nova-compute[87365]:   </clock>
Nov 08 13:47:28 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:47:28 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:47:28 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:47:28 user nova-compute[87365]:   </cpu>
Nov 08 13:47:28 user nova-compute[87365]:   <devices>
Nov 08 13:47:28 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:47:28 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:47:28 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk"/>
Nov 08 13:47:28 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:47:28 user nova-compute[87365]:     </disk>
Nov 08 13:47:28 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:28 user nova-compute[87365]:       <mac address="fa:16:3e:bf:dc:3f"/>
Nov 08 13:47:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:28 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:28 user nova-compute[87365]:       <target dev="tap8487e943-47"/>
Nov 08 13:47:28 user nova-compute[87365]:     </interface>
Nov 08 13:47:28 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:47:28 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/console.log" append="off"/>
Nov 08 13:47:28 user nova-compute[87365]:     </serial>
Nov 08 13:47:28 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:47:28 user nova-compute[87365]:     <video>
Nov 08 13:47:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:28 user nova-compute[87365]:     </video>
Nov 08 13:47:28 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:47:28 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:47:28 user nova-compute[87365]:     </rng>
Nov 08 13:47:28 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:47:28 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:47:28 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:47:28 user nova-compute[87365]:     </memballoon>
Nov 08 13:47:28 user nova-compute[87365]:   </devices>
Nov 08 13:47:28 user nova-compute[87365]: </domain>
Nov 08 13:47:28 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-978346557',display_name='tempest-tempest.common.compute-instance-978346557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-978346557',id=16,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXssOCN6l/BHRW8eYhwE/+KFpIm6yZAz+7PkYmeevUzCp4InPVQp+u9pz8vhJDmHM4iGSRQguFaolJQxr0wTymCCCouBr7rmsCpZbHhdxLPc17+hEnzAvYx6PBQWGBzRQ==',key_name='tempest-keypair-1114508957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-vdqtxa2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=7f48b991-bd55-400d-ac6a-5ed4f976b6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG os_vif [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91509b10-058f-5cb8-987c-88d7ca71de04', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8487e943-47, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8487e943-47, col_values=(('qos', UUID('9efd3603-d98a-430a-b099-c5d7c9a23d80')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8487e943-47, col_values=(('external_ids', {'iface-id': '8487e943-4746-43ff-93db-f364699a6d3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:dc:3f', 'vm-uuid': '7f48b991-bd55-400d-ac6a-5ed4f976b6a0'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:28 user nova-compute[87365]: INFO os_vif [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47')
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No VIF found with MAC fa:16:3e:bf:dc:3f, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updated VIF entry in instance network info cache for port 8487e943-4746-43ff-93db-f364699a6d3c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c352b2b4-7cc9-4583-89e2-2aa12de5654c req-3c189913-b4dc-436e-aec5-953a69b7784c service nova] Releasing lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:32 user nova-compute[87365]: WARNING nova.compute.manager [req-be1e6d30-9c90-4696-9d08-ca89ff2dd2f1 req-3fc23235-8f62-493b-857d-6a53803c4e01 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state building and task_state spawning.
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:32 user nova-compute[87365]: WARNING nova.compute.manager [req-2a0d0f73-bd9b-4577-8e82-6cf84434f835 req-8af998dc-78a6-4b0c-b10b-c0c596daddd7 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state building and task_state spawning.
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:47:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance spawned successfully.
Nov 08 13:47:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=24.810020446777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:32 user nova-compute[87365]: INFO nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9743709b-872f-4248-bc61-b41122126030 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance aa1308b7-4354-4938-a96f-663a78f096e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:47:32 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:47:32 user nova-compute[87365]: INFO nova.compute.manager [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Took 7.08 seconds to build instance.
Nov 08 13:47:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f4b42a8c-3684-4acc-b923-8197e0b9467a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.235s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'serial': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb7cee04-ba81-4e92-be4d-36db9206705f', 'serial'} {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:33 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:33 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:33 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1fde30-4a57-45c1-aa3f-05646d61ccfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:47:33 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f69da-2ced-4097-8a65-4987b7062f3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d] added
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92398fb-7f44-44f0-856c-f25ea08f0eb8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc1848e-9f4c-40f1-81b7-e00836461bd5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGaLVJqd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGaLVJqd" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf5396-e68b-43d0-a448-531edf9af71c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGaLVJqd'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b475e-f77c-4323-900a-d4d629f13a1c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5901e1-2a4d-4e57-967d-ee36e6fb0126]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --login" returned: 0 in 0.193s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3035efa-8ab6-4696-bc3a-dbfb9aea1587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260]
Nov 08 13:47:33 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e9c5de-e266-4fbe-9f00-b9068ba81b24]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ea3b1-2c65-4772-9d31-c57625d93eb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:33 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc2c88c-035d-41a2-8a46-cde5cfde1f25]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:47:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23037393664306266', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037393664306266', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:47:34 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lazy-loading 'flavor' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 106954752 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 405798912 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 530579456 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 910163968 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 1066401792 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:40 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[752933ef-d564-4b14-9d82-faf08758f74c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:47:40 user nova-compute[87365]: No targets found.
Nov 08 13:47:40 user nova-compute[87365]: iSNS:
Nov 08 13:47:40 user nova-compute[87365]: No targets found.
Nov 08 13:47:40 user nova-compute[87365]: STATIC:
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:47:40 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:40 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:40 user nova-compute[87365]: FIRMWARE:
Nov 08 13:47:40 user nova-compute[87365]: No targets found.
Nov 08 13:47:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:47:40 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:47:40 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ca5d33-e449-4370-8c7d-5b92e3df8e00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1298bf4-650c-439f-b800-cb0d2d7c3250]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d180a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab138a65-9769-4ebc-91be-cfd297c5634d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[671349de-4209-4959-8f77-46f9eff16077]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[703990f4-d636-488a-b1bf-ad51c29d283a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3801ac5-777c-4550-bee9-ba9da3cd3ee2]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b82d71-2fb0-45e5-9978-6b51ed0fd9d1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13a601-573f-4479-a0be-efc85fad5d96]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]
Nov 08 13:47:40 user nova-compute[87365]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd796691-bad5-4eb9-8df1-5e38f876111e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== disconnect_volume: return (344ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'serial'} {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 13:47:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: removing Cinder connection for volume bb7cee04-ba81-4e92-be4d-36db9206705f {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 13:47:41 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: Updating volume bb7cee04-ba81-4e92-be4d-36db9206705f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "lGaLVJqd", "auth_password": "4nY2tHwjcrZz1e", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d"}, "status": "reserved", "instance": "f33f05cc-e996-4596-bd14-c47e64994f89", "attached_at": "", "detached_at": "", "volume_id": "4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d", "serial": "4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'no_device': None, 'attachment_id': 'f8ac4d66-0778-431e-aac5-2a4502410b78'} {{(pid=87365) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 13:47:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f910e484-2f38-4d30-993f-6c330972c27f tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 38.730s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.utils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d6eae-f9d5-4826-bc85-881d4c867f91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eeb398-27aa-4431-b931-62d25aa75602]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad9d12-8bb3-4a50-863a-95113199f8c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfaa94a-c50c-441f-a3e1-82e645470691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: INFO nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Booting with volume a404af20-3cc6-4a6f-8d8f-82728700f86b at /dev/vdc
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:42 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c6e5c-5e4f-49d0-9add-bf0f581127e5]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.utils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[367cf772-17a1-4e65-981d-ad0b553f13f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec40b69-976e-48a5-a336-fc457f7dac2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:42 user nova-compute[87365]: INFO nova.compute.manager [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Swapping volume 4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d for bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb5784-fbec-49be-928c-6a7d6cd52b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91bea77-952f-4d60-988e-7d88c0f89a53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9743709b-872f-4248-bc61-b41122126030 is timed out.
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:47:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Successfully detached device vdb from instance 9743709b-872f-4248-bc61-b41122126030 from the live domain config.
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCPdIBbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:47:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:47:43 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[766bcb7f-ca6e-43a6-8994-9a6aa56e8c43]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.utils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating existing volume attachment record: d223534f-90e9-4172-8c93-9f01a51ab786 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6c845-2c0c-4e50-ba97-088f581c974b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:47:43 user nova-compute[87365]: No targets found.
Nov 08 13:47:43 user nova-compute[87365]: iSNS:
Nov 08 13:47:43 user nova-compute[87365]: No targets found.
Nov 08 13:47:43 user nova-compute[87365]: STATIC:
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:47:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:47:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:47:43 user nova-compute[87365]: FIRMWARE:
Nov 08 13:47:43 user nova-compute[87365]: No targets found.
Nov 08 13:47:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:47:43 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:47:43 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec7de4-d6ec-4128-97e6-0ac459bc90f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[81418875-9264-4db4-8f65-94eba8aa5702]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:47:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4f92e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6dfc2d-7123-4e10-922c-9d35ed06f48b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3e9e6-3871-4457-8a01-6715a72ab2ad]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0950776-d893-4a9a-96ba-dcea819c1271]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60887b-72cc-4687-bfbd-651c5c74810b]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc467a8c-7b11-44b8-ae28-bb2c0d173cac]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[735899dd-35d6-4b20-a010-73beb344112f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260]
Nov 08 13:47:43 user nova-compute[87365]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617, portal: 172.16.0.220,3260] successful.
Nov 08 13:47:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c71ebe6-c3f2-4e69-a9cf-f3ded8c56617 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12cd4d-05af-407e-b36e-d7fed66ea827]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] <== disconnect_volume: return (359ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] [instance: 9743709b-872f-4248-bc61-b41122126030] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:47:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lazy-loading 'flavor' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-dae6ed94-e85e-4b86-a905-e11f85f5fc16 tempest-VolumesAssistedSnapshotsTest-1971778002 tempest-VolumesAssistedSnapshotsTest-1971778002-project-admin] Lock "9743709b-872f-4248-bc61-b41122126030" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.825s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:47:46 user nova-compute[87365]: INFO nova.compute.claims [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Claim successful on node user
Nov 08 13:47:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:47:46 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:47:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.policy [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7002ccda1ce646f4a0a771982c76d3f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa801fe72a5410fade93d2db86d1f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:47:47 user nova-compute[87365]: INFO nova.compute.claims [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Claim successful on node user
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:47:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Creating image(s)
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "/opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "/opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "/opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk 1073741824" returned: 0 in 0.076s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Successfully created port: daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:47:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Cannot resize image /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Ensure instance console log exists: /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.policy [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79591337fdf04987a71c530710f02cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecbc55af780947ccb2be9cc2c159d611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:47:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Creating image(s)
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "/opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "/opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "/opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Successfully updated port: daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquired lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-changed-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Refreshing instance network info cache due to event network-changed-daf49e96-476e-4a21-a80f-a192b67afc32. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] Acquiring lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.225s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk 1073741824" returned: 0 in 0.307s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.536s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Successfully created port: ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Updating instance_info_cache with network_info: [{"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Releasing lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Instance network_info: |[{"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] Acquired lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Refreshing network info cache for port daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Start _get_guest_xml network_info=[{"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:47:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057702666',display_name='tempest-VolumesAdminNegativeTest-server-1057702666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057702666',id=17,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-pp3f3349',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:47Z,user_data=None,user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=f51b5079-52de-44b5-8c51-c475e740a5a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.objects.instance [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'pci_devices' on Instance uuid f51b5079-52de-44b5-8c51-c475e740a5a7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:47:49 user nova-compute[87365]:   <uuid>f51b5079-52de-44b5-8c51-c475e740a5a7</uuid>
Nov 08 13:47:49 user nova-compute[87365]:   <name>instance-00000011</name>
Nov 08 13:47:49 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:47:49 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:47:49 user nova-compute[87365]:   <metadata>
Nov 08 13:47:49 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:47:49 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1057702666</nova:name>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:47:49</nova:creationTime>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:47:49 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:47:49 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:owner>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:user uuid="7002ccda1ce646f4a0a771982c76d3f1">tempest-VolumesAdminNegativeTest-1087803050-project-member</nova:user>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:project uuid="0fa801fe72a5410fade93d2db86d1f9d">tempest-VolumesAdminNegativeTest-1087803050</nova:project>
Nov 08 13:47:49 user nova-compute[87365]:       </nova:owner>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:47:49 user nova-compute[87365]:       <nova:ports>
Nov 08 13:47:49 user nova-compute[87365]:         <nova:port uuid="daf49e96-476e-4a21-a80f-a192b67afc32">
Nov 08 13:47:49 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 13:47:49 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:49 user nova-compute[87365]:       </nova:ports>
Nov 08 13:47:49 user nova-compute[87365]:     </nova:instance>
Nov 08 13:47:49 user nova-compute[87365]:   </metadata>
Nov 08 13:47:49 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:47:49 user nova-compute[87365]:     <system>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="serial">f51b5079-52de-44b5-8c51-c475e740a5a7</entry>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="uuid">f51b5079-52de-44b5-8c51-c475e740a5a7</entry>
Nov 08 13:47:49 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:47:49 user nova-compute[87365]:     </system>
Nov 08 13:47:49 user nova-compute[87365]:   </sysinfo>
Nov 08 13:47:49 user nova-compute[87365]:   <os>
Nov 08 13:47:49 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:47:49 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:47:49 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:47:49 user nova-compute[87365]:   </os>
Nov 08 13:47:49 user nova-compute[87365]:   <features>
Nov 08 13:47:49 user nova-compute[87365]:     <acpi/>
Nov 08 13:47:49 user nova-compute[87365]:     <apic/>
Nov 08 13:47:49 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:47:49 user nova-compute[87365]:   </features>
Nov 08 13:47:49 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:47:49 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:47:49 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:47:49 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:47:49 user nova-compute[87365]:   </clock>
Nov 08 13:47:49 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:47:49 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:47:49 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:47:49 user nova-compute[87365]:   </cpu>
Nov 08 13:47:49 user nova-compute[87365]:   <devices>
Nov 08 13:47:49 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:47:49 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:47:49 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk"/>
Nov 08 13:47:49 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:47:49 user nova-compute[87365]:     </disk>
Nov 08 13:47:49 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:49 user nova-compute[87365]:       <mac address="fa:16:3e:7a:c6:ce"/>
Nov 08 13:47:49 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:49 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:49 user nova-compute[87365]:       <target dev="tapdaf49e96-47"/>
Nov 08 13:47:49 user nova-compute[87365]:     </interface>
Nov 08 13:47:49 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:47:49 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/console.log" append="off"/>
Nov 08 13:47:49 user nova-compute[87365]:     </serial>
Nov 08 13:47:49 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:47:49 user nova-compute[87365]:     <video>
Nov 08 13:47:49 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:49 user nova-compute[87365]:     </video>
Nov 08 13:47:49 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:47:49 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:47:49 user nova-compute[87365]:     </rng>
Nov 08 13:47:49 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:47:49 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:47:49 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:47:49 user nova-compute[87365]:     </memballoon>
Nov 08 13:47:49 user nova-compute[87365]:   </devices>
Nov 08 13:47:49 user nova-compute[87365]: </domain>
Nov 08 13:47:49 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057702666',display_name='tempest-VolumesAdminNegativeTest-server-1057702666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057702666',id=17,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-pp3f3349',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:47Z,user_data=None,user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=f51b5079-52de-44b5-8c51-c475e740a5a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG os_vif [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75752e5e-9dac-5693-8975-0461ca1a1d1c', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaf49e96-47, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaf49e96-47, col_values=(('qos', UUID('f6315092-8d75-4be6-a102-355250f8fea8')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaf49e96-47, col_values=(('external_ids', {'iface-id': 'daf49e96-476e-4a21-a80f-a192b67afc32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:c6:ce', 'vm-uuid': 'f51b5079-52de-44b5-8c51-c475e740a5a7'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Cannot resize image /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Ensure instance console log exists: /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:49 user nova-compute[87365]: INFO os_vif [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47')
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] No VIF found with MAC fa:16:3e:7a:c6:ce, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Updated VIF entry in instance network info cache for port daf49e96-476e-4a21-a80f-a192b67afc32. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Updating instance_info_cache with network_info: [{"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1ec98ab-a608-4846-8b22-7d8c0f9a6474 req-d5fb64be-9cf7-4478-b115-f919794262da service nova] Releasing lock "refresh_cache-f51b5079-52de-44b5-8c51-c475e740a5a7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Successfully updated port: ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquired lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-changed-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Refreshing instance network info cache due to event network-changed-ac8aae6e-8d90-41b4-981b-928ab3b46048. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] Acquiring lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:47:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Updating instance_info_cache with network_info: [{"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Releasing lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Instance network_info: |[{"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] Acquired lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Refreshing network info cache for port ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Start _get_guest_xml network_info=[{"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:47:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785940180',display_name='tempest-VolumesActionsTest-instance-785940180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785940180',id=18,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-93akhd50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:48Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=acf686d8-40c3-4bf1-96d2-fcb9d6cae212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.objects.instance [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lazy-loading 'pci_devices' on Instance uuid acf686d8-40c3-4bf1-96d2-fcb9d6cae212 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:47:50 user nova-compute[87365]:   <uuid>acf686d8-40c3-4bf1-96d2-fcb9d6cae212</uuid>
Nov 08 13:47:50 user nova-compute[87365]:   <name>instance-00000012</name>
Nov 08 13:47:50 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:47:50 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:47:50 user nova-compute[87365]:   <metadata>
Nov 08 13:47:50 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:47:50 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:name>tempest-VolumesActionsTest-instance-785940180</nova:name>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:47:50</nova:creationTime>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:47:50 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:47:50 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:owner>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:user uuid="79591337fdf04987a71c530710f02cb4">tempest-VolumesActionsTest-1737829010-project-member</nova:user>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:project uuid="ecbc55af780947ccb2be9cc2c159d611">tempest-VolumesActionsTest-1737829010</nova:project>
Nov 08 13:47:50 user nova-compute[87365]:       </nova:owner>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:47:50 user nova-compute[87365]:       <nova:ports>
Nov 08 13:47:50 user nova-compute[87365]:         <nova:port uuid="ac8aae6e-8d90-41b4-981b-928ab3b46048">
Nov 08 13:47:50 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 13:47:50 user nova-compute[87365]:         </nova:port>
Nov 08 13:47:50 user nova-compute[87365]:       </nova:ports>
Nov 08 13:47:50 user nova-compute[87365]:     </nova:instance>
Nov 08 13:47:50 user nova-compute[87365]:   </metadata>
Nov 08 13:47:50 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:47:50 user nova-compute[87365]:     <system>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="serial">acf686d8-40c3-4bf1-96d2-fcb9d6cae212</entry>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="uuid">acf686d8-40c3-4bf1-96d2-fcb9d6cae212</entry>
Nov 08 13:47:50 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:47:50 user nova-compute[87365]:     </system>
Nov 08 13:47:50 user nova-compute[87365]:   </sysinfo>
Nov 08 13:47:50 user nova-compute[87365]:   <os>
Nov 08 13:47:50 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:47:50 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:47:50 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:47:50 user nova-compute[87365]:   </os>
Nov 08 13:47:50 user nova-compute[87365]:   <features>
Nov 08 13:47:50 user nova-compute[87365]:     <acpi/>
Nov 08 13:47:50 user nova-compute[87365]:     <apic/>
Nov 08 13:47:50 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:47:50 user nova-compute[87365]:   </features>
Nov 08 13:47:50 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:47:50 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:47:50 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:47:50 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:47:50 user nova-compute[87365]:   </clock>
Nov 08 13:47:50 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:47:50 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:47:50 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:47:50 user nova-compute[87365]:   </cpu>
Nov 08 13:47:50 user nova-compute[87365]:   <devices>
Nov 08 13:47:50 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:47:50 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:47:50 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk"/>
Nov 08 13:47:50 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:47:50 user nova-compute[87365]:     </disk>
Nov 08 13:47:50 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:47:50 user nova-compute[87365]:       <mac address="fa:16:3e:62:63:bd"/>
Nov 08 13:47:50 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:50 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:47:50 user nova-compute[87365]:       <target dev="tapac8aae6e-8d"/>
Nov 08 13:47:50 user nova-compute[87365]:     </interface>
Nov 08 13:47:50 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:47:50 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/console.log" append="off"/>
Nov 08 13:47:50 user nova-compute[87365]:     </serial>
Nov 08 13:47:50 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:47:50 user nova-compute[87365]:     <video>
Nov 08 13:47:50 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:47:50 user nova-compute[87365]:     </video>
Nov 08 13:47:50 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:47:50 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:47:50 user nova-compute[87365]:     </rng>
Nov 08 13:47:50 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:47:50 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:47:50 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:47:50 user nova-compute[87365]:     </memballoon>
Nov 08 13:47:50 user nova-compute[87365]:   </devices>
Nov 08 13:47:50 user nova-compute[87365]: </domain>
Nov 08 13:47:50 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785940180',display_name='tempest-VolumesActionsTest-instance-785940180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785940180',id=18,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-93akhd50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:48Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=acf686d8-40c3-4bf1-96d2-fcb9d6cae212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG os_vif [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ad7f99f-73c7-5034-8330-5e4e7edc492f', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac8aae6e-8d, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac8aae6e-8d, col_values=(('qos', UUID('f7b597e0-ec42-4e35-8e13-1640ddc33329')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac8aae6e-8d, col_values=(('external_ids', {'iface-id': 'ac8aae6e-8d90-41b4-981b-928ab3b46048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:63:bd', 'vm-uuid': 'acf686d8-40c3-4bf1-96d2-fcb9d6cae212'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: INFO os_vif [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d')
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] No VIF found with MAC fa:16:3e:62:63:bd, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Updated VIF entry in instance network info cache for port ac8aae6e-8d90-41b4-981b-928ab3b46048. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Updating instance_info_cache with network_info: [{"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ff6c64a0-92c3-4b58-8426-59dffcf64d62 req-b2dd1d51-0872-4786-997f-43fa4c180c9d service nova] Releasing lock "refresh_cache-acf686d8-40c3-4bf1-96d2-fcb9d6cae212" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] No waiting events found dispatching network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:51 user nova-compute[87365]: WARNING nova.compute.manager [req-5af971ab-fd54-45ad-b7a3-59d480497c87 req-91ece97f-7dc6-4f2e-9222-5cbe48eb9bf0 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received unexpected event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 for instance with vm_state building and task_state spawning.
Nov 08 13:47:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] No waiting events found dispatching network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:52 user nova-compute[87365]: WARNING nova.compute.manager [req-1ed2b186-b076-4151-b1a8-49e450cb3586 req-8b878a64-f0a1-43c4-938f-f999924dd107 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received unexpected event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 for instance with vm_state building and task_state spawning.
Nov 08 13:47:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] No waiting events found dispatching network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:53 user nova-compute[87365]: WARNING nova.compute.manager [req-4b6500e8-5857-4846-90b1-ab4d8b29dc84 req-75aa878e-6941-4068-8872-b248828e2040 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received unexpected event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 for instance with vm_state building and task_state spawning.
Nov 08 13:47:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:47:54 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Instance spawned successfully.
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:54 user nova-compute[87365]: INFO nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:47:54 user nova-compute[87365]: INFO nova.compute.manager [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Took 8.63 seconds to build instance.
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] No waiting events found dispatching network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:47:54 user nova-compute[87365]: WARNING nova.compute.manager [req-0390cb95-b4de-4133-bcf0-2b22b21685b7 req-4c70918d-10b8-44a6-a43e-dfb1712a2f7d service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received unexpected event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 for instance with vm_state building and task_state spawning.
Nov 08 13:47:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0a4aec61-7ce4-4180-b6d9-340616956265 tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.744s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:47:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Instance spawned successfully.
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:47:55 user nova-compute[87365]: INFO nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 08 13:47:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:47:55 user nova-compute[87365]: INFO nova.compute.manager [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Took 8.33 seconds to build instance.
Nov 08 13:47:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-005d605e-f81a-4f22-bafd-5d317083ff00 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.478s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:47:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "9743709b-872f-4248-bc61-b41122126030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "9743709b-872f-4248-bc61-b41122126030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:10 user nova-compute[87365]: INFO nova.compute.manager [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Terminating instance
Nov 08 13:48:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 9743709b-872f-4248-bc61-b41122126030] Instance destroyed successfully.
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lazy-loading 'resources' on Instance uuid 9743709b-872f-4248-bc61-b41122126030 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-152995279',display_name='tempest-VolumesAssistedSnapshotsTest-server-152995279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-152995279',id=10,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPyPPQ8Z6WvNaatA9jYSz8jpUMSjTUNQ6khirv34KOigulkb7+MF8t/BHPExhKuLcuLXq+IkiGTmGQ1KVhNr6ohmPDSSYfStUoNyQaUJv4Qz7WPEs+JPsv0cljn0DZSog==',key_name='tempest-keypair-1737111603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b953219fed343b6bf6d0776e1ad43b3',ramdisk_id='',reservation_id='r-0c1fx06h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-816186852',owner_user_name='tempest-VolumesAssistedSnapshotsTest-816186852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ffa552e93fa4d5180f81ac161f516af',uuid=9743709b-872f-4248-bc61-b41122126030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converting VIF {"id": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "address": "fa:16:3e:6a:04:64", "network": {"id": "f89253e2-7b75-4ecc-a818-c9f725187eed", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2096319826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b953219fed343b6bf6d0776e1ad43b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96de7723-5a", "ovs_interfaceid": "96de7723-5a4f-4126-ae3e-1d9ea45ada5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG os_vif [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96de7723-5a, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e9893fc-1fff-46e7-ab1f-9afcec07a0cd) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:11 user nova-compute[87365]: INFO os_vif [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:04:64,bridge_name='br-int',has_traffic_filtering=True,id=96de7723-5a4f-4126-ae3e-1d9ea45ada5b,network=Network(f89253e2-7b75-4ecc-a818-c9f725187eed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96de7723-5a')
Nov 08 13:48:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Deleting instance files /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030_del
Nov 08 13:48:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Deletion of /opt/stack/data/nova/instances/9743709b-872f-4248-bc61-b41122126030_del complete
Nov 08 13:48:11 user nova-compute[87365]: INFO nova.compute.manager [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] [instance: 9743709b-872f-4248-bc61-b41122126030] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 13:48:11 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 9743709b-872f-4248-bc61-b41122126030] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 9743709b-872f-4248-bc61-b41122126030] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-unplugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] Acquiring lock "9743709b-872f-4248-bc61-b41122126030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] No waiting events found dispatching network-vif-unplugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-4a33a8a2-36d5-40fe-8bba-121e1baa482d req-5a09dd69-f7d9-41a8-942c-8d7e88908415 service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-unplugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 9743709b-872f-4248-bc61-b41122126030] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:13 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 9743709b-872f-4248-bc61-b41122126030] Took 2.16 seconds to deallocate network for instance.
Nov 08 13:48:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] Acquiring lock "9743709b-872f-4248-bc61-b41122126030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] Lock "9743709b-872f-4248-bc61-b41122126030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] No waiting events found dispatching network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:13 user nova-compute[87365]: WARNING nova.compute.manager [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received unexpected event network-vif-plugged-96de7723-5a4f-4126-ae3e-1d9ea45ada5b for instance with vm_state deleted and task_state None.
Nov 08 13:48:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-207abc82-3637-4046-947a-aac641e24c35 req-bade02cb-c1ae-48b5-9934-ddff61c3654e service nova] [instance: 9743709b-872f-4248-bc61-b41122126030] Received event network-vif-deleted-96de7723-5a4f-4126-ae3e-1d9ea45ada5b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:14 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:48:14 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:48:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:14 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Deleted allocations for instance 9743709b-872f-4248-bc61-b41122126030
Nov 08 13:48:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cc3cc00-c44c-46da-93ea-3917df20576d tempest-VolumesAssistedSnapshotsTest-816186852 tempest-VolumesAssistedSnapshotsTest-816186852-project-member] Lock "9743709b-872f-4248-bc61-b41122126030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.819s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:48:15 user nova-compute[87365]: INFO nova.compute.claims [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Claim successful on node user
Nov 08 13:48:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:48:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.policy [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfb0a0d029584372a281f2deb15c1ec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4647686e56564f89bacdec5e20e47d2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:48:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Creating image(s)
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "/opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "/opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk 1073741824" returned: 0 in 0.071s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Successfully created port: 8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:48:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Cannot resize image /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Ensure instance console log exists: /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Successfully updated port: 8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquired lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-changed-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Refreshing instance network info cache due to event network-changed-8b16b74b-85f1-4fd3-b217-059cf6305f21. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] Acquiring lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Updating instance_info_cache with network_info: [{"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Releasing lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Instance network_info: |[{"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] Acquired lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Refreshing network info cache for port 8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Start _get_guest_xml network_info=[{"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:48:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-673889953',display_name='tempest-VolumesActionsTest-instance-673889953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-673889953',id=19,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4647686e56564f89bacdec5e20e47d2a',ramdisk_id='',reservation_id='r-05qsvd9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471425088',owner_user_name='tempest-VolumesActionsTest-1471425088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:48:16Z,user_data=None,user_id='bfb0a0d029584372a281f2deb15c1ec2',uuid=e5a7bc12-2741-4ccc-98b2-98be4451aae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converting VIF {"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lazy-loading 'pci_devices' on Instance uuid e5a7bc12-2741-4ccc-98b2-98be4451aae3 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:48:17 user nova-compute[87365]:   <uuid>e5a7bc12-2741-4ccc-98b2-98be4451aae3</uuid>
Nov 08 13:48:17 user nova-compute[87365]:   <name>instance-00000013</name>
Nov 08 13:48:17 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:48:17 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:48:17 user nova-compute[87365]:   <metadata>
Nov 08 13:48:17 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:48:17 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:name>tempest-VolumesActionsTest-instance-673889953</nova:name>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:48:17</nova:creationTime>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:48:17 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:48:17 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:owner>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:user uuid="bfb0a0d029584372a281f2deb15c1ec2">tempest-VolumesActionsTest-1471425088-project-member</nova:user>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:project uuid="4647686e56564f89bacdec5e20e47d2a">tempest-VolumesActionsTest-1471425088</nova:project>
Nov 08 13:48:17 user nova-compute[87365]:       </nova:owner>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:48:17 user nova-compute[87365]:       <nova:ports>
Nov 08 13:48:17 user nova-compute[87365]:         <nova:port uuid="8b16b74b-85f1-4fd3-b217-059cf6305f21">
Nov 08 13:48:17 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:48:17 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:17 user nova-compute[87365]:       </nova:ports>
Nov 08 13:48:17 user nova-compute[87365]:     </nova:instance>
Nov 08 13:48:17 user nova-compute[87365]:   </metadata>
Nov 08 13:48:17 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:48:17 user nova-compute[87365]:     <system>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="serial">e5a7bc12-2741-4ccc-98b2-98be4451aae3</entry>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="uuid">e5a7bc12-2741-4ccc-98b2-98be4451aae3</entry>
Nov 08 13:48:17 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:48:17 user nova-compute[87365]:     </system>
Nov 08 13:48:17 user nova-compute[87365]:   </sysinfo>
Nov 08 13:48:17 user nova-compute[87365]:   <os>
Nov 08 13:48:17 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:48:17 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:48:17 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:48:17 user nova-compute[87365]:   </os>
Nov 08 13:48:17 user nova-compute[87365]:   <features>
Nov 08 13:48:17 user nova-compute[87365]:     <acpi/>
Nov 08 13:48:17 user nova-compute[87365]:     <apic/>
Nov 08 13:48:17 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:48:17 user nova-compute[87365]:   </features>
Nov 08 13:48:17 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:48:17 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:48:17 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:48:17 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:48:17 user nova-compute[87365]:   </clock>
Nov 08 13:48:17 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:48:17 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:48:17 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:48:17 user nova-compute[87365]:   </cpu>
Nov 08 13:48:17 user nova-compute[87365]:   <devices>
Nov 08 13:48:17 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:48:17 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:48:17 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk"/>
Nov 08 13:48:17 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:48:17 user nova-compute[87365]:     </disk>
Nov 08 13:48:17 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:17 user nova-compute[87365]:       <mac address="fa:16:3e:ed:f3:fa"/>
Nov 08 13:48:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:17 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:17 user nova-compute[87365]:       <target dev="tap8b16b74b-85"/>
Nov 08 13:48:17 user nova-compute[87365]:     </interface>
Nov 08 13:48:17 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:48:17 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/console.log" append="off"/>
Nov 08 13:48:17 user nova-compute[87365]:     </serial>
Nov 08 13:48:17 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:48:17 user nova-compute[87365]:     <video>
Nov 08 13:48:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:17 user nova-compute[87365]:     </video>
Nov 08 13:48:17 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:48:17 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:48:17 user nova-compute[87365]:     </rng>
Nov 08 13:48:17 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:48:17 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:48:17 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:48:17 user nova-compute[87365]:     </memballoon>
Nov 08 13:48:17 user nova-compute[87365]:   </devices>
Nov 08 13:48:17 user nova-compute[87365]: </domain>
Nov 08 13:48:17 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-673889953',display_name='tempest-VolumesActionsTest-instance-673889953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-673889953',id=19,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4647686e56564f89bacdec5e20e47d2a',ramdisk_id='',reservation_id='r-05qsvd9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1471425088',owner_user_name='tempest-VolumesActionsTest-1471425088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:48:16Z,user_data=None,user_id='bfb0a0d029584372a281f2deb15c1ec2',uuid=e5a7bc12-2741-4ccc-98b2-98be4451aae3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converting VIF {"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG os_vif [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67b62511-fb84-5a6e-ab46-5192293e5e32', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b16b74b-85, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b16b74b-85, col_values=(('qos', UUID('0aaef4f3-aa28-43c8-aa8e-eb5a7fbaa11c')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b16b74b-85, col_values=(('external_ids', {'iface-id': '8b16b74b-85f1-4fd3-b217-059cf6305f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f3:fa', 'vm-uuid': 'e5a7bc12-2741-4ccc-98b2-98be4451aae3'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:17 user nova-compute[87365]: INFO os_vif [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85')
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:48:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] No VIF found with MAC fa:16:3e:ed:f3:fa, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:48:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Updated VIF entry in instance network info cache for port 8b16b74b-85f1-4fd3-b217-059cf6305f21. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:48:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Updating instance_info_cache with network_info: [{"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5a0c922f-f070-4431-92a9-fc2578a3317d req-83d06022-a7cc-480a-98f0-17db15559b60 service nova] Releasing lock "refresh_cache-e5a7bc12-2741-4ccc-98b2-98be4451aae3" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] No waiting events found dispatching network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:19 user nova-compute[87365]: WARNING nova.compute.manager [req-5789e553-1d5d-4356-ba5f-654808fc19e3 req-ea954fac-38db-48ba-b13a-d17dfdc94cfe service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received unexpected event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 for instance with vm_state building and task_state spawning.
Nov 08 13:48:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:20 user nova-compute[87365]: INFO nova.compute.manager [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Rescuing
Nov 08 13:48:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:21 user nova-compute[87365]: WARNING nova.compute.manager [req-484628c0-b540-4dc0-a06a-d94055fa40d1 req-22f1a8c5-4a30-4451-8e6c-d9894efbb439 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state rescuing.
Nov 08 13:48:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] No waiting events found dispatching network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:21 user nova-compute[87365]: WARNING nova.compute.manager [req-14f20c0e-c21c-4b5d-b2ac-efe69005b83d req-f7d9add5-4f75-4e4f-94c0-622258bbaa2d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received unexpected event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 for instance with vm_state building and task_state spawning.
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Instance spawned successfully.
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance destroyed successfully.
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Attempting rescue
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=87365) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Creating image(s)
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 08 13:48:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:48:21 user nova-compute[87365]: INFO nova.compute.manager [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Took 6.66 seconds to build instance.
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a7d5c48c-b5bd-45ce-9c18-085496533c5b tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.765s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'migration_context' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<02327cf5-f6ca-41c9-983c-f74508ef6b46> lazy-loaded attributes: trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start _get_guest_xml network_info=[{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:a0:93:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'resources' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<02327cf5-f6ca-41c9-983c-f74508ef6b46> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'numa_topology' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<02327cf5-f6ca-41c9-983c-f74508ef6b46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:48:22 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:22 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<02327cf5-f6ca-41c9-983c-f74508ef6b46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2093578167',display_name='tempest-ServerRescueNegativeTestJSON-server-2093578167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2093578167',id=1,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-cyoj7o71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:43:49Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=02327cf5-f6ca-41c9-983c-f74508ef6b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:a0:93:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "vif_mac": "fa:16:3e:a0:93:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'pci_devices' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Object Instance<02327cf5-f6ca-41c9-983c-f74508ef6b46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:48:22 user nova-compute[87365]:   <uuid>02327cf5-f6ca-41c9-983c-f74508ef6b46</uuid>
Nov 08 13:48:22 user nova-compute[87365]:   <name>instance-00000001</name>
Nov 08 13:48:22 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:48:22 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:48:22 user nova-compute[87365]:   <metadata>
Nov 08 13:48:22 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:48:22 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2093578167</nova:name>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:48:22</nova:creationTime>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:48:22 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:48:22 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:owner>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:user uuid="74300a84ce074dd38166c961d57071cd">tempest-ServerRescueNegativeTestJSON-954030017-project-member</nova:user>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:project uuid="4ddd66e9d6104a2c8e71279551cb6b4d">tempest-ServerRescueNegativeTestJSON-954030017</nova:project>
Nov 08 13:48:22 user nova-compute[87365]:       </nova:owner>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:48:22 user nova-compute[87365]:       <nova:ports>
Nov 08 13:48:22 user nova-compute[87365]:         <nova:port uuid="fc315d33-8442-42b3-8efd-61482b1fab32">
Nov 08 13:48:22 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 13:48:22 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:22 user nova-compute[87365]:       </nova:ports>
Nov 08 13:48:22 user nova-compute[87365]:     </nova:instance>
Nov 08 13:48:22 user nova-compute[87365]:   </metadata>
Nov 08 13:48:22 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:48:22 user nova-compute[87365]:     <system>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="serial">02327cf5-f6ca-41c9-983c-f74508ef6b46</entry>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="uuid">02327cf5-f6ca-41c9-983c-f74508ef6b46</entry>
Nov 08 13:48:22 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:48:22 user nova-compute[87365]:     </system>
Nov 08 13:48:22 user nova-compute[87365]:   </sysinfo>
Nov 08 13:48:22 user nova-compute[87365]:   <os>
Nov 08 13:48:22 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:48:22 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:48:22 user nova-compute[87365]:   </os>
Nov 08 13:48:22 user nova-compute[87365]:   <features>
Nov 08 13:48:22 user nova-compute[87365]:     <acpi/>
Nov 08 13:48:22 user nova-compute[87365]:     <apic/>
Nov 08 13:48:22 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:48:22 user nova-compute[87365]:   </features>
Nov 08 13:48:22 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:48:22 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:48:22 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:48:22 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:48:22 user nova-compute[87365]:   </clock>
Nov 08 13:48:22 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:48:22 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:48:22 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:48:22 user nova-compute[87365]:   </cpu>
Nov 08 13:48:22 user nova-compute[87365]:   <devices>
Nov 08 13:48:22 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:48:22 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:48:22 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue"/>
Nov 08 13:48:22 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:48:22 user nova-compute[87365]:     </disk>
Nov 08 13:48:22 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:48:22 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:48:22 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk"/>
Nov 08 13:48:22 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:48:22 user nova-compute[87365]:     </disk>
Nov 08 13:48:22 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:22 user nova-compute[87365]:       <mac address="fa:16:3e:a0:93:c6"/>
Nov 08 13:48:22 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:22 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:22 user nova-compute[87365]:       <target dev="tapfc315d33-84"/>
Nov 08 13:48:22 user nova-compute[87365]:     </interface>
Nov 08 13:48:22 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:48:22 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/console.log" append="off"/>
Nov 08 13:48:22 user nova-compute[87365]:     </serial>
Nov 08 13:48:22 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:48:22 user nova-compute[87365]:     <video>
Nov 08 13:48:22 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:22 user nova-compute[87365]:     </video>
Nov 08 13:48:22 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:48:22 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:48:22 user nova-compute[87365]:     </rng>
Nov 08 13:48:22 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:48:22 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:48:22 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:48:22 user nova-compute[87365]:     </memballoon>
Nov 08 13:48:22 user nova-compute[87365]:   </devices>
Nov 08 13:48:22 user nova-compute[87365]: </domain>
Nov 08 13:48:22 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:48:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance destroyed successfully.
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No VIF found with MAC fa:16:3e:a0:93:c6, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:48:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:23 user nova-compute[87365]: WARNING nova.compute.manager [req-4ce3811c-f43c-4c8c-854f-0f3e9acfbc02 req-921971d9-a9eb-40aa-96a0-784e2883a4d7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state rescuing.
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-changed-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing instance network info cache due to event network-changed-7bd652d1-1c41-4309-b3b1-658c10d9cf0d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] Acquiring lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] Acquired lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG nova.network.neutron [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Refreshing network info cache for port 7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG nova.network.neutron [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updated VIF entry in instance network info cache for port 7bd652d1-1c41-4309-b3b1-658c10d9cf0d. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG nova.network.neutron [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6dc96d59-2c89-4e47-a638-2e824de2000f req-7b6008e2-46db-486d-aabe-6306998962d6 service nova] Releasing lock "refresh_cache-aa1308b7-4354-4938-a96f-663a78f096e5" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:25 user nova-compute[87365]: WARNING nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state rescuing.
Nov 08 13:48:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:25 user nova-compute[87365]: WARNING nova.compute.manager [req-320c6fbd-740a-4419-a4ee-48891fbf58ad req-6511c2eb-50b5-45fc-8296-0ed57254f86a service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state rescuing.
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:25 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1ff757f1-0550-4bcc-8621-f777a506b61e tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:26 user nova-compute[87365]: INFO nova.compute.manager [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Terminating instance
Nov 08 13:48:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-18aa73d4-46e5-46d3-9801-61eab3a5c86b req-67eab687-e3e7-4877-ad7c-b593d2b3b1ac service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-c96d25b9-a6e2-40d5-a9bd-f359662653f2 req-b7fba76c-eb34-4b0a-a2e6-4cf00467bfa6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Instance destroyed successfully.
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lazy-loading 'resources' on Instance uuid aa1308b7-4354-4938-a96f-663a78f096e5 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bd652d1-1c, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1aa2275-4a2f-4ea8-aabf-5ffce7151ec5) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:f1:c9,bridge_name='br-int',has_traffic_filtering=True,id=7bd652d1-1c41-4309-b3b1-658c10d9cf0d,network=Network(cd622969-fea9-4dac-98c5-0fa7309143c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd652d1-1c')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0d1ec9d-44, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=119dee71-5d16-4da0-a21d-86b1fc8075f4) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-7bd652d1-1c41-4309-b3b1-658c10d9cf0d for instance with vm_state active and task_state deleting.
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-f0d1ec9d-444c-48c8-8037-97b39a953724 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-f0d1ec9d-444c-48c8-8037-97b39a953724 for instance with vm_state active and task_state deleting.
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde for instance with vm_state active and task_state deleting.
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 for instance with vm_state active and task_state deleting.
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING nova.compute.manager [req-635474e1-d689-4188-bc58-5df782420431 req-6d59ce46-8a50-4704-beaf-cc7a21d17ae6 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-18a6839a-9731-4d8d-8e7d-48656f5983d4 for instance with vm_state active and task_state deleting.
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:bb:bc,bridge_name='br-int',has_traffic_filtering=True,id=f0d1ec9d-444c-48c8-8037-97b39a953724,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0d1ec9d-44')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ea3bd8d-37, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e483c19e-db52-4c38-b56b-bfbe18cd877f) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:75:e6,bridge_name='br-int',has_traffic_filtering=True,id=6ea3bd8d-376e-4192-9cc6-d9548af4d496,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6ea3bd8d-37')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "address": "fa:16:3e:b0:35:ac", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3d170e-87", "ovs_interfaceid": "8d3d170e-87b7-4968-a83b-38a3a9a0c232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d3d170e-87, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1224cb6-971e-4324-ac63-d1d74a391f43) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:35:ac,bridge_name='br-int',has_traffic_filtering=True,id=8d3d170e-87b7-4968-a83b-38a3a9a0c232,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3d170e-87')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7d0482a-c0, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12a64ff0-aa55-4ea4-9bbe-26c6670f273b) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:5d:ee,bridge_name='br-int',has_traffic_filtering=True,id=c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde,network=Network(5b48a532-7c1b-406c-a424-8e9a48e28dd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d0482a-c0')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4e8509-7c, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aba8e05-703d-4cff-9675-a9d5ce8630ff) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:38:ee,bridge_name='br-int',has_traffic_filtering=True,id=6b4e8509-7c27-40e9-a9b8-30a9d94adff8,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4e8509-7c')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2101620831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2101620831',id=13,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnyBMSImpLaTKwQ7kTzquaq/e6DtkDqME8ZlrFUSDxRIibJYOs2qxso93lJVgJADoKFV8qY6PKijv8A6d+0ZSOr3BZYF9zSLXQjcUIza45k8fz9ZUcR39xr0UGOAmi32g==',key_name='tempest-keypair-2038232604',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2e921e38cdc46f6b9e82be020e4c982',ramdisk_id='',reservation_id='r-it1icnvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-966933490',owner_user_name='tempest-TaggedBootDevicesTest-966933490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14a50a4f5253401dbb4647133d73ecca',uuid=aa1308b7-4354-4938-a96f-663a78f096e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converting VIF {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a6839a-97, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2592bff4-4e0a-42c0-8f68-e45917546b12) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:29 user nova-compute[87365]: INFO os_vif [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:77:c9,bridge_name='br-int',has_traffic_filtering=True,id=18a6839a-9731-4d8d-8e7d-48656f5983d4,network=Network(36153fe7-9eca-4ccc-a85a-fa073f4c51a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a6839a-97')
Nov 08 13:48:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcAYNWkR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:29 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0cb97b-099d-44de-899a-9abfcdfc2c42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:48:29 user nova-compute[87365]: No targets found.
Nov 08 13:48:29 user nova-compute[87365]: iSNS:
Nov 08 13:48:29 user nova-compute[87365]: No targets found.
Nov 08 13:48:29 user nova-compute[87365]: STATIC:
Nov 08 13:48:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495
Nov 08 13:48:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd
Nov 08 13:48:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:48:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:48:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:48:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:29 user nova-compute[87365]: FIRMWARE:
Nov 08 13:48:29 user nova-compute[87365]: No targets found.
Nov 08 13:48:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:48:29 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:48:29 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[532978e8-a97b-4051-8117-f4531145518c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d292a83a-52ef-47ed-9d5f-d753974d5432]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:48:29 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d1c3d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e12ad-c555-4c94-84ef-b763dd54aa9d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[87435c1c-b315-48ba-9eb3-bcc0a21b5d6a]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f2647-d250-464e-a409-671e992f36e8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:48:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e708e801-9a00-462d-9ad2-24c02075f36a]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a3a3b-d903-488c-a34e-250cf488be0d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ffcbc7-f68f-42a5-89fc-67c9710d4ed5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260]
Nov 08 13:48:30 user nova-compute[87365]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36cc0e21-f366-44e8-92d5-3bee25be6ffd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e5dc0-6d09-4477-8a86-641635751019]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== disconnect_volume: return (410ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMbxTpDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:30 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f0a76-cb7d-4dc1-b7aa-d148d87426d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]: iSNS:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]: STATIC:
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: FIRMWARE:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:48:30 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:48:30 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:30 user nova-compute[87365]: WARNING nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-6ea3bd8d-376e-4192-9cc6-d9548af4d496 for instance with vm_state active and task_state deleting.
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-unplugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-unplugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Acquiring lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] Lock "aa1308b7-4354-4938-a96f-663a78f096e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] No waiting events found dispatching network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:30 user nova-compute[87365]: WARNING nova.compute.manager [req-6a93746a-2e4a-420f-8abe-e70c5768da7e req-22d7ce48-a88f-4892-93a2-d90a87ff58ea service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received unexpected event network-vif-plugged-8d3d170e-87b7-4968-a83b-38a3a9a0c232 for instance with vm_state active and task_state deleting.
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380822d-7d62-42df-b0ed-bd90a181f3d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e642bde5-465e-49cf-8505-609254d0c9aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d18296050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d259ff4-72a9-421b-8bc9-1c03b40fee34]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba525e6-de37-4856-aed1-b43c490caeb7]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5aee6-5eae-4d07-89f7-7d257f679d08]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bede9bfe-6127-452a-bbad-158453cce52c]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae2eac-4252-45c7-b88a-606a4d4f3288]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5099cb6-e111-4d40-9960-2158014295ec]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260]
Nov 08 13:48:30 user nova-compute[87365]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1ddeaa8-d88a-455d-8cb4-37f75861b495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b5217-38e1-479e-bef8-1ee954948134]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== disconnect_volume: return (425ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIQjRsnJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:30 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.042s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[15601165-d886-409e-ae12-a0aeb66d50a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]: iSNS:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]: STATIC:
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:48:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:30 user nova-compute[87365]: FIRMWARE:
Nov 08 13:48:30 user nova-compute[87365]: No targets found.
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:48:30 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:48:30 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d682d320-5470-4ee5-8bcb-10b1eb6b3b46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d9ff7-66d0-4550-a6ea-c6f13d602874]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:30 user nova-compute[87365]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 (non-flash)
Nov 08 13:48:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d1c3d3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242'): ({'sdg'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Removing single pathed devices sdg {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb976a51-29d4-46fa-82b3-e70d293c7094]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42809c65-14dd-4156-9115-74918b6e0c5d]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Flushing IO for device /dev/sdg {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c92248-8279-4e49-9332-fa48fcd5367a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b65528-b772-4509-9133-003ea9236493]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] SCSI volumes sdg have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ebef9-89a8-493c-9c8f-e6577d3968cc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a98a71a-12f4-4844-8605-2efe6ab6b1f6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260]
Nov 08 13:48:31 user nova-compute[87365]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:31 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ed40b9b-1b23-4fdf-8ed4-49095a352242 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb54c6c-c2c9-45c0-af00-3c17e290a5e0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] <== disconnect_volume: return (430ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:48:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Deleting instance files /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5_del
Nov 08 13:48:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Deletion of /opt/stack/data/nova/instances/aa1308b7-4354-4938-a96f-663a78f096e5_del complete
Nov 08 13:48:31 user nova-compute[87365]: INFO nova.compute.manager [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Took 4.47 seconds to destroy the instance on the hypervisor.
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:33 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:33 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=24.776439666748047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance aa1308b7-4354-4938-a96f-663a78f096e5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f51b5079-52de-44b5-8c51-c475e740a5a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance acf686d8-40c3-4bf1-96d2-fcb9d6cae212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e5a7bc12-2741-4ccc-98b2-98be4451aae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-ea17ef6f-1144-4f90-a0a9-4d676425d5c8 req-e21ca7a1-205b-4f56-a740-9e78aec1b41e service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-deleted-8d3d170e-87b7-4968-a83b-38a3a9a0c232 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:33 user nova-compute[87365]: INFO nova.compute.manager [req-ea17ef6f-1144-4f90-a0a9-4d676425d5c8 req-e21ca7a1-205b-4f56-a740-9e78aec1b41e service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Neutron deleted interface 8d3d170e-87b7-4968-a83b-38a3a9a0c232; detaching it from the instance and deleting it from the info cache
Nov 08 13:48:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-ea17ef6f-1144-4f90-a0a9-4d676425d5c8 req-e21ca7a1-205b-4f56-a740-9e78aec1b41e service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [{"id": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "address": "fa:16:3e:fc:f1:c9", "network": {"id": "cd622969-fea9-4dac-98c5-0fa7309143c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1757327035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd652d1-1c", "ovs_interfaceid": "7bd652d1-1c41-4309-b3b1-658c10d9cf0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0d1ec9d-444c-48c8-8037-97b39a953724", "address": "fa:16:3e:9a:bb:bc", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d1ec9d-44", "ovs_interfaceid": "f0d1ec9d-444c-48c8-8037-97b39a953724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "address": "fa:16:3e:0d:75:e6", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ea3bd8d-37", "ovs_interfaceid": "6ea3bd8d-376e-4192-9cc6-d9548af4d496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "address": "fa:16:3e:2b:5d:ee", "network": {"id": "5b48a532-7c1b-406c-a424-8e9a48e28dd0", "bridge": "br-int", "label": "tempest-device-tagging-net1-348016331", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d0482a-c0", "ovs_interfaceid": "c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "address": "fa:16:3e:2d:38:ee", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4e8509-7c", "ovs_interfaceid": "6b4e8509-7c27-40e9-a9b8-30a9d94adff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "address": "fa:16:3e:74:77:c9", "network": {"id": "36153fe7-9eca-4ccc-a85a-fa073f4c51a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-864008127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d2e921e38cdc46f6b9e82be020e4c982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a6839a-97", "ovs_interfaceid": "18a6839a-9731-4d8d-8e7d-48656f5983d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-ea17ef6f-1144-4f90-a0a9-4d676425d5c8 req-e21ca7a1-205b-4f56-a740-9e78aec1b41e service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Detach interface failed, port_id=8d3d170e-87b7-4968-a83b-38a3a9a0c232, reason: Instance aa1308b7-4354-4938-a96f-663a78f096e5 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:35 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Took 4.38 seconds to deallocate network for instance.
Nov 08 13:48:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:48:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-6b285428-b144-48f3-8bd9-f63b057657de req-f3e62f20-4b95-46d9-a6a8-bbb1204bc815 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-deleted-6b4e8509-7c27-40e9-a9b8-30a9d94adff8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-6b285428-b144-48f3-8bd9-f63b057657de req-f3e62f20-4b95-46d9-a6a8-bbb1204bc815 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-deleted-7bd652d1-1c41-4309-b3b1-658c10d9cf0d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-6b285428-b144-48f3-8bd9-f63b057657de req-f3e62f20-4b95-46d9-a6a8-bbb1204bc815 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-deleted-c7d0482a-c027-4dc7-a2cb-d7a2f82f0dde {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-6b285428-b144-48f3-8bd9-f63b057657de req-f3e62f20-4b95-46d9-a6a8-bbb1204bc815 service nova] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Received event network-vif-deleted-18a6839a-9731-4d8d-8e7d-48656f5983d4 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:38 user nova-compute[87365]: INFO nova.compute.manager [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] [instance: aa1308b7-4354-4938-a96f-663a78f096e5] Took 3.05 seconds to detach 3 volumes for instance.
Nov 08 13:48:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:39 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:48:39 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:48:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:39 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Deleted allocations for instance aa1308b7-4354-4938-a96f-663a78f096e5
Nov 08 13:48:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acb514c3-40a6-4914-856f-ba1da1215a48 tempest-TaggedBootDevicesTest-966933490 tempest-TaggedBootDevicesTest-966933490-project-member] Lock "aa1308b7-4354-4938-a96f-663a78f096e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.624s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb7cee04-ba81-4e92-be4d-36db9206705f', 'serial': 'bb7cee04-ba81-4e92-be4d-36db9206705f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d'}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'serial'} {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:40 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:40 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:40 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e616d3-a471-4198-b687-dd89dcd4a296]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:48:40 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c7d40-8291-4211-8275-74ff30249b9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f] added
Nov 08 13:48:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf80808-68a0-45b1-815e-29a6d4a01eb9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a37e7-b85e-4c46-9554-02bfa7a9464a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnqcoSLW {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnqcoSLW" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d45af-5195-4d6c-9a25-3d6bf94bdb77]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnqcoSLW'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46acb8-e480-4706-b1eb-7df6e0cf563c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[47de2f7e-79dd-429f-9e80-3a23183529a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:48:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Creating image(s)
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Ensure instance console log exists: /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Start _get_guest_xml network_info=[{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yApTmgUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c7e345e-69ff-421a-b79c-e6efa33ca95d', 'attached_at': '', 'detached_at': '', 'volume_id': 'adfd1674-c9ea-419d-9e2d-f376eb8bb106', 'serial': 'adfd1674-c9ea-419d-9e2d-f376eb8bb106'}, 'attachment_id': '65aaaa0f-60dd-479b-82c2-2d645a80e8ea', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tobPrqEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c7e345e-69ff-421a-b79c-e6efa33ca95d', 'attached_at': '', 'detached_at': '', 'volume_id': '6f10e358-0661-4612-a6f1-6d9b2d55c82b', 'serial': '6f10e358-0661-4612-a6f1-6d9b2d55c82b'}, 'attachment_id': '97023f43-dcbb-4ad0-a104-2754a2744ae5', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpdLCvHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c7e345e-69ff-421a-b79c-e6efa33ca95d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a404af20-3cc6-4a6f-8d8f-82728700f86b', 'serial': 'a404af20-3cc6-4a6f-8d8f-82728700f86b'}, 'attachment_id': 'd223534f-90e9-4172-8c93-9f01a51ab786', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f0204-bcca-4e1d-bd15-1dad7c1536ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]
Nov 08 13:48:41 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:41 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yApTmgUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:41 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[385baf2f-b8b9-4be2-8712-fbbe5fa4c254]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[185256e1-f497-4385-a480-8b56eaad1a9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:41 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87402e1-1003-4b62-af4c-fbc299e1d193]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23465356630646366', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465356630646366', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.061s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:42 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:42 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lazy-loading 'flavor' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05bef09-b537-4404-9bd7-b87be69907ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:48:42 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bdd5dd-d125-4ac7-84f2-8767e9fdf12f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106] added
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b47f779-04b2-436a-98ff-f3d5066b9219]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f9612-0163-4a49-887b-d3ca4a7e0b07]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yApTmgUV {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yApTmgUV" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b00ba46-7d95-436d-89d0-67b499b87f9c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yApTmgUV'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a0561-e0e3-4685-8e44-06a9f76b018e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[051c90e4-8874-4712-af5c-0a3a43ed8c63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af9d33-db8f-4006-a08c-8ee753cdc927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260]
Nov 08 13:48:42 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9160ba4-94fa-4882-9e13-8ac0699069e3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fc3686-6ffe-4e71-abb1-58e74fe2e6ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:42 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c306662-2f0c-46cb-9257-7cc0e63b438c]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 94371840 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yApTmgUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== connect_volume: return (2386ms) {'type': 'block', 'scsi_wwn': '23635306539376265', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635306539376265', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tobPrqEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:43 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b1671e-b9cc-41f3-b196-29e8c2767e03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:48:43 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2508473f-fb2e-4f38-aa7d-be199fd2759b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b] added
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3fa90a-75d6-40bd-ade3-fe4415207557]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 249561088 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d96b5d-79f8-49a8-9055-9d83b1a7016b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tobPrqEU {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tobPrqEU" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a28ee-2d1c-4158-808c-8856c9202953]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tobPrqEU'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26478d0e-bfdc-4c9e-84c1-5578a633ac39]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec5864-7b40-4d1b-902b-5e18f1d208c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[819000a3-a933-4260-8217-8777829c5e43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260]
Nov 08 13:48:43 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc928223-2f65-49f4-8164-4c2ec3c27aef]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a25030-805d-4822-b7ee-b7de17e15bce]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:43 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:48:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[264de7dc-fa3a-4e30-a78e-0db2c2b30966]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 585105408 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tobPrqEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26565666437353464', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565666437353464', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpdLCvHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:45 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:45 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:45 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a686518c-0779-471f-96ef-b26bb5027c31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:48:45 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d3e79-ce5d-4e1f-a045-dbd23f2a8abf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b] added
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46b002-3742-4068-86eb-b083133cfe4a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c56e3-6c0e-4943-bfc4-591f638af9aa]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpdLCvHV {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SpdLCvHV" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2a512-fd95-40a7-86a9-1446ee5bf2e9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SpdLCvHV'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 686817280 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71412dd-ce6f-438a-9cc2-f463aa761273]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a1dc2-0e65-4f76-8882-7fda9a8078bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733b26c-bdc2-4618-a284-b43a09c0d397]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260]
Nov 08 13:48:45 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2d38f-4a1e-4ece-b6d0-bf7c94714ddc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bce887-b2b0-4c1e-9d8a-2f787c9bfce7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:48:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0c9d7-2a9c-4110-afdd-d60a3be6ef13]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 976224256 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpdLCvHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23235383638353632', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383638353632', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c7e345e-69ff-421a-b79c-e6efa33ca95d {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:48:46 user nova-compute[87365]:   <uuid>4c7e345e-69ff-421a-b79c-e6efa33ca95d</uuid>
Nov 08 13:48:46 user nova-compute[87365]:   <name>instance-0000000e</name>
Nov 08 13:48:46 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:48:46 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:48:46 user nova-compute[87365]:   <metadata>
Nov 08 13:48:46 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:48:46 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:name>tempest-device-tagging-server-1151537456</nova:name>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:48:41</nova:creationTime>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:48:46 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:48:46 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:owner>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:user uuid="55bd41d1019d482daeddf21aa8c4080e">tempest-TaggedBootDevicesTest_v242-370745883-project-member</nova:user>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:project uuid="dc866ab8a5c04f8697b04aef5c329c25">tempest-TaggedBootDevicesTest_v242-370745883</nova:project>
Nov 08 13:48:46 user nova-compute[87365]:       </nova:owner>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:48:46 user nova-compute[87365]:       <nova:ports>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="fa99f959-b5cf-4f15-9aec-60884cb6a997">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="edbfd8ac-b523-4e52-9860-28d483b6fd29">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="12f689fe-2af5-4edb-a405-742859e76b3c">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="98b64a69-dc60-4118-89bc-2694600d9bbe">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="34759ed9-3ca9-43ca-a427-f6202da5368a">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="10643c61-1acb-4bcd-ace5-5b4b5204d871">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:         <nova:port uuid="2ec10073-2ba4-4a46-84cb-c432b524b85b">
Nov 08 13:48:46 user nova-compute[87365]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 13:48:46 user nova-compute[87365]:         </nova:port>
Nov 08 13:48:46 user nova-compute[87365]:       </nova:ports>
Nov 08 13:48:46 user nova-compute[87365]:     </nova:instance>
Nov 08 13:48:46 user nova-compute[87365]:   </metadata>
Nov 08 13:48:46 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:48:46 user nova-compute[87365]:     <system>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="serial">4c7e345e-69ff-421a-b79c-e6efa33ca95d</entry>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="uuid">4c7e345e-69ff-421a-b79c-e6efa33ca95d</entry>
Nov 08 13:48:46 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:48:46 user nova-compute[87365]:     </system>
Nov 08 13:48:46 user nova-compute[87365]:   </sysinfo>
Nov 08 13:48:46 user nova-compute[87365]:   <os>
Nov 08 13:48:46 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:48:46 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:48:46 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:48:46 user nova-compute[87365]:   </os>
Nov 08 13:48:46 user nova-compute[87365]:   <features>
Nov 08 13:48:46 user nova-compute[87365]:     <acpi/>
Nov 08 13:48:46 user nova-compute[87365]:     <apic/>
Nov 08 13:48:46 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:48:46 user nova-compute[87365]:   </features>
Nov 08 13:48:46 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:48:46 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:48:46 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:48:46 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:48:46 user nova-compute[87365]:   </clock>
Nov 08 13:48:46 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:48:46 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:48:46 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:48:46 user nova-compute[87365]:   </cpu>
Nov 08 13:48:46 user nova-compute[87365]:   <devices>
Nov 08 13:48:46 user nova-compute[87365]:     <disk type="file" device="cdrom">
Nov 08 13:48:46 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 13:48:46 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/disk.config"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="hda" bus="ide"/>
Nov 08 13:48:46 user nova-compute[87365]:     </disk>
Nov 08 13:48:46 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:48:46 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:48:46 user nova-compute[87365]:       <source dev="/dev/sdd"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <serial>adfd1674-c9ea-419d-9e2d-f376eb8bb106</serial>
Nov 08 13:48:46 user nova-compute[87365]:     </disk>
Nov 08 13:48:46 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:48:46 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:48:46 user nova-compute[87365]:       <source dev="/dev/sde"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <serial>6f10e358-0661-4612-a6f1-6d9b2d55c82b</serial>
Nov 08 13:48:46 user nova-compute[87365]:     </disk>
Nov 08 13:48:46 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:48:46 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:48:46 user nova-compute[87365]:       <source dev="/dev/sdf"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="vdc" bus="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <serial>a404af20-3cc6-4a6f-8d8f-82728700f86b</serial>
Nov 08 13:48:46 user nova-compute[87365]:     </disk>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:79:86:db"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tapfa99f959-b5"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:05:fd:33"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tapedbfd8ac-b5"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:db:2b:17"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tap12f689fe-2a"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:33:f8:a5"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tap98b64a69-dc"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:b8:dd:e3"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tap34759ed9-3c"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:f3:6d:2d"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tap10643c61-1a"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:48:46 user nova-compute[87365]:       <mac address="fa:16:3e:51:7e:9d"/>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:48:46 user nova-compute[87365]:       <target dev="tap2ec10073-2b"/>
Nov 08 13:48:46 user nova-compute[87365]:     </interface>
Nov 08 13:48:46 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:48:46 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/console.log" append="off"/>
Nov 08 13:48:46 user nova-compute[87365]:     </serial>
Nov 08 13:48:46 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:48:46 user nova-compute[87365]:     <video>
Nov 08 13:48:46 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:48:46 user nova-compute[87365]:     </video>
Nov 08 13:48:46 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:48:46 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:48:46 user nova-compute[87365]:     </rng>
Nov 08 13:48:46 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:48:46 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:48:46 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:48:46 user nova-compute[87365]:     </memballoon>
Nov 08 13:48:46 user nova-compute[87365]:   </devices>
Nov 08 13:48:46 user nova-compute[87365]: </domain>
Nov 08 13:48:46 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90c6a2ef-b780-5c08-8cfa-994ffc0e95ff', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa99f959-b5, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa99f959-b5, col_values=(('qos', UUID('871904b5-c815-4bb5-b901-1bec8e0734e8')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa99f959-b5, col_values=(('external_ids', {'iface-id': 'fa99f959-b5cf-4f15-9aec-60884cb6a997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:86:db', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5')
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffcf5c81-8223-5f7f-8c2b-616724625cd4', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedbfd8ac-b5, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedbfd8ac-b5, col_values=(('qos', UUID('51820447-fd0a-462f-ae85-38c2a974d418')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedbfd8ac-b5, col_values=(('external_ids', {'iface-id': 'edbfd8ac-b523-4e52-9860-28d483b6fd29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:fd:33', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5')
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12298868-28b7-53b3-b787-ee79149bb9bf', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12f689fe-2a, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12f689fe-2a, col_values=(('qos', UUID('8204b73d-ba83-4c88-8384-a1c632019455')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12f689fe-2a, col_values=(('external_ids', {'iface-id': '12f689fe-2af5-4edb-a405-742859e76b3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2b:17', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a')
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35d921a6-5126-5bdc-b1c6-b40a06af91f7', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98b64a69-dc, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98b64a69-dc, col_values=(('qos', UUID('ddb0c1c0-6464-45c7-a6e7-9439fc627d64')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98b64a69-dc, col_values=(('external_ids', {'iface-id': '98b64a69-dc60-4118-89bc-2694600d9bbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f8:a5', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc')
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be7e07db-1078-501a-a939-cc7788e46b54', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34759ed9-3c, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34759ed9-3c, col_values=(('qos', UUID('042a88cd-b98f-4624-b31d-bfa61dd1ed20')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34759ed9-3c, col_values=(('external_ids', {'iface-id': '34759ed9-3ca9-43ca-a427-f6202da5368a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:dd:e3', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGaLVJqd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a20f83d-cb71-4a9a-bb37-8219c2ca461a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:48:46 user nova-compute[87365]: No targets found.
Nov 08 13:48:46 user nova-compute[87365]: iSNS:
Nov 08 13:48:46 user nova-compute[87365]: No targets found.
Nov 08 13:48:46 user nova-compute[87365]: STATIC:
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:48:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:48:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:48:46 user nova-compute[87365]: FIRMWARE:
Nov 08 13:48:46 user nova-compute[87365]: No targets found.
Nov 08 13:48:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:48:46 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:48:46 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c')
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e180345e-e362-558f-8f2c-f13f46ce4704', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c069a84-efdd-41b1-aa00-71dfd423187f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d4b59-7ffd-429a-955d-4a26e183713f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:48:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:48:46 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:48:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d180a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10643c61-1a, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10643c61-1a, col_values=(('qos', UUID('f2cb8806-eff5-4a82-a4d0-224d1fbadd60')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10643c61-1a, col_values=(('external_ids', {'iface-id': '10643c61-1acb-4bcd-ace5-5b4b5204d871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:6d:2d', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2d2be-aada-47e5-b3aa-aff92f062a2a]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b18de42-7000-45de-9c24-e9ac23bbe885]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9395bbcf-ec27-495d-b452-f89311f6e203]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a')
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd269243b-3d87-5a2e-8d3f-0cc0979fc785', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49f6c0-abc6-43aa-8da9-51fc41a32d7d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ec10073-2b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ec10073-2b, col_values=(('qos', UUID('ead37f39-9b01-4290-a405-27a4afd5dc4d')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ec10073-2b, col_values=(('external_ids', {'iface-id': '2ec10073-2ba4-4a46-84cb-c432b524b85b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:7e:9d', 'vm-uuid': '4c7e345e-69ff-421a-b79c-e6efa33ca95d'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a819dc9-fb93-4a2c-a091-aaf9b568070d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:47 user nova-compute[87365]: INFO os_vif [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b')
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac2ca0-87fb-45c5-abb8-74bf415ee2b8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260]
Nov 08 13:48:47 user nova-compute[87365]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d, portal: 172.16.0.220,3260] successful.
Nov 08 13:48:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a613b8-37e9-44ff-b96a-e8302a4ad4df]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] <== disconnect_volume: return (338ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] No BDM found with device name hda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] No VIF found with MAC fa:16:3e:79:86:db, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] No VIF found with MAC fa:16:3e:b8:dd:e3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:48:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Using config drive
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f33f05cc-e996-4596-bd14-c47e64994f89', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb7cee04-ba81-4e92-be4d-36db9206705f', 'serial'} {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: removing Cinder connection for volume 4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d {{(pid=87365) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 13:48:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Creating config drive at /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/disk.config
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr2ul63of {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr2ul63of" returned: 0 in 0.059s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] swap_volume: Updating volume 4dce6b0e-3eaf-4f65-8e2f-4f25a9d6fe9d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dnqcoSLW", "auth_password": "cXIaonh21AQHNU", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "bb7cee04-ba81-4e92-be4d-36db9206705f"}, "status": "reserved", "instance": "f33f05cc-e996-4596-bd14-c47e64994f89", "attached_at": "", "detached_at": "", "volume_id": "bb7cee04-ba81-4e92-be4d-36db9206705f", "serial": "bb7cee04-ba81-4e92-be4d-36db9206705f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bb7cee04-ba81-4e92-be4d-36db9206705f', 'no_device': None, 'attachment_id': '14345f18-fcd2-43a7-a9b9-9303be849443'} {{(pid=87365) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a0ea9c3-f3e7-4fc9-8cc2-8575b729d948 tempest-TestVolumeSwap-1213327622 tempest-TestVolumeSwap-1213327622-project-admin] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 65.558s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:48 user nova-compute[87365]: INFO nova.compute.manager [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Detaching volume bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:48:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:48 user nova-compute[87365]: INFO nova.virt.block_device [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Attempting to driver detach volume bb7cee04-ba81-4e92-be4d-36db9206705f from mountpoint /dev/vdb
Nov 08 13:48:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Attempting to detach device vdb from instance f33f05cc-e996-4596-bd14-c47e64994f89 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:48:48 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:48:48 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:48:48 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:48:48 user nova-compute[87365]:   <serial>bb7cee04-ba81-4e92-be4d-36db9206705f</serial>
Nov 08 13:48:48 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:48:48 user nova-compute[87365]: </disk>
Nov 08 13:48:48 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:48:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Successfully detached device vdb from instance f33f05cc-e996-4596-bd14-c47e64994f89 from the persistent domain config.
Nov 08 13:48:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f33f05cc-e996-4596-bd14-c47e64994f89 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:48:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:48:48 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:48:48 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:48:48 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:48:48 user nova-compute[87365]:   <serial>bb7cee04-ba81-4e92-be4d-36db9206705f</serial>
Nov 08 13:48:48 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:48:48 user nova-compute[87365]: </disk>
Nov 08 13:48:48 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:49 user nova-compute[87365]: WARNING nova.compute.manager [req-7df43149-148d-48c4-917a-f15ca34ee8f1 req-672ab9fb-ffc9-4efe-8e93-127c48534724 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 for instance with vm_state building and task_state spawning.
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:50 user nova-compute[87365]: WARNING nova.compute.manager [req-a270ef9a-9d7c-4a0e-b7a4-68ffdc9c18f8 req-982c1398-a4a9-4afb-8f86-0dc78d45c15c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c for instance with vm_state building and task_state spawning.
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:50 user nova-compute[87365]: WARNING nova.compute.manager [req-5f8eb694-e238-4c8c-9ff8-f4d226517478 req-73f3fc26-7685-4bb4-b770-2a2ec745b57e service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe for instance with vm_state building and task_state spawning.
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:51 user nova-compute[87365]: WARNING nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 for instance with vm_state building and task_state spawning.
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:51 user nova-compute[87365]: WARNING nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 for instance with vm_state building and task_state spawning.
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:51 user nova-compute[87365]: WARNING nova.compute.manager [req-41fa77ba-f65b-4601-880e-b23400e6e8e4 req-dafd2f83-8ea4-43f1-bdc0-68ebf58e371f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 for instance with vm_state building and task_state spawning.
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:51 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:48:51 user nova-compute[87365]: INFO nova.compute.claims [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Claim successful on node user
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-7a2e75f3-24c8-49e8-9642-837f2caa31b7 req-57e96c97-ff97-4f05-a8d0-2bb41eb23ed1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:48:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.policy [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c385effdb74adbb4b090ada3770c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa81d579f8d14baa86b0279e7cf22974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:48:52 user nova-compute[87365]: INFO nova.virt.block_device [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Booting with volume 73d2b27e-1b0c-4c12-a936-634d295ec3c6 at /dev/vda
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.utils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING nova.compute.manager [req-5e8fd5de-5731-4002-acf7-9159ed3262f6 req-90acb21f-6132-4d2a-a28b-4d87b23eed02 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b for instance with vm_state building and task_state spawning.
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d222cf-23b5-48e5-acaa-d32a7fe76bce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6839da7c-8da9-492b-902e-b02fb3f19caa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca7664-0883-4940-8f3e-c22f10d70fa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf356d2-ebd5-424b-aa54-f654d5f870cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:48:52 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:48:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebacfd82-edb4-40eb-ae3a-3143ca665a18]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG os_brick.utils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:48:52 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating existing volume attachment record: 6cb3661f-93eb-45af-ba7e-d3285a8df7f7 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Successfully created port: ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:48:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance spawned successfully.
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:48:53 user nova-compute[87365]: INFO nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Took 12.42 seconds to spawn the instance on the hypervisor.
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Successfully updated port: ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquired lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:48:53 user nova-compute[87365]: INFO nova.compute.manager [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Took 145.12 seconds to build instance.
Nov 08 13:48:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2112a2d5-8072-498b-a084-5120108924c2 tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 145.224s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-changed-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Refreshing instance network info cache due to event network-changed-ebc4bfed-137f-440f-8d98-792d50d2b020. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] Acquiring lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:48:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating instance_info_cache with network_info: [{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Releasing lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance network_info: |[{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] Acquired lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Refreshing network info cache for port ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updated VIF entry in instance network info cache for port ebc4bfed-137f-440f-8d98-792d50d2b020. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating instance_info_cache with network_info: [{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:48:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a53971b4-7383-4a79-af3e-08286ff9c650 req-5161d508-5e43-46e3-822b-3f2e44d4c841 service nova] Releasing lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:48:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:48:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:09 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f33f05cc-e996-4596-bd14-c47e64994f89 is timed out.
Nov 08 13:49:09 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Successfully detached device vdb from instance f33f05cc-e996-4596-bd14-c47e64994f89 from the live domain config.
Nov 08 13:49:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnqcoSLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'bb7cee04-ba81-4e92-be4d-36db9206705f'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:09 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b48e531-739e-46e3-a0ca-c14539555d1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:49:09 user nova-compute[87365]: No targets found.
Nov 08 13:49:09 user nova-compute[87365]: iSNS:
Nov 08 13:49:09 user nova-compute[87365]: No targets found.
Nov 08 13:49:09 user nova-compute[87365]: STATIC:
Nov 08 13:49:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106
Nov 08 13:49:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:49:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f
Nov 08 13:49:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:49:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:49:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:09 user nova-compute[87365]: FIRMWARE:
Nov 08 13:49:09 user nova-compute[87365]: No targets found.
Nov 08 13:49:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:49:09 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:49:09 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f893ab2-6151-415a-937e-a65eb1d0762d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e078f6e8-621d-4609-bd8e-a5ff936bbfe1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:09 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf856ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c652b81e-94e6-4239-9e45-c5862b2b4b77]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[661951df-4cf3-4a93-844f-31ea4d1beb05]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0dae8c-965e-464f-8b43-41e07e7ab2a4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c48d1e4-991d-4965-92f3-92b7116e919e]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:49:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a4b10-cb0f-4f87-a9ab-4c970ffcbc26]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3785cb0d-f966-4226-a504-9f9065212bfe]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260]
Nov 08 13:49:10 user nova-compute[87365]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f, portal: 172.16.0.220,3260] successful.
Nov 08 13:49:10 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7cee04-ba81-4e92-be4d-36db9206705f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e063281-af97-497b-a95f-641ac8748f8b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] <== disconnect_volume: return (368ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:49:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:12 user nova-compute[87365]: INFO nova.compute.manager [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Rescuing
Nov 08 13:49:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lazy-loading 'flavor' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1c3f2fcd-776a-4643-83d5-5e28deb0b4c6 tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.886s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:13 user nova-compute[87365]: WARNING nova.compute.manager [req-d51299c2-8de8-4dfd-a7bf-1deeae319933 req-8d9d6c14-5c46-4aa9-a44e-eb10dc1421d8 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state active and task_state rescuing.
Nov 08 13:49:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance destroyed successfully.
Nov 08 13:49:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Attempting a stable device rescue
Nov 08 13:49:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=87365) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:49:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Creating image(s)
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'trusted_certs' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:15 user nova-compute[87365]: WARNING nova.compute.manager [req-53e7c561-5cb1-47ab-bd63-9b7c7517c96d req-fd2a6617-2f94-47f6-aad7-eea8c2e943e0 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state active and task_state rescuing.
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.part --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG nova.virt.images [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] 322733a3-8c95-470e-827f-e200b25ec740 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.part /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.part /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.converted" returned: 0 in 0.378s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.300s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b,backing_fmt=raw /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b,backing_fmt=raw /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue" returned: 0 in 0.051s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "73bfff7c5188f567c4093a0bc67a0ccec8658a5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'migration_context' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<368e18ac-eebe-44e9-a2e2-e7059dd82243> lazy-loaded attributes: trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start _get_guest_xml network_info=[{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:2b:0f:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '322733a3-8c95-470e-827f-e200b25ec740', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '368e18ac-eebe-44e9-a2e2-e7059dd82243', 'attached_at': '', 'detached_at': '', 'volume_id': '06a464b2-b817-4838-b7ae-a029d6a2b60e', 'serial': '06a464b2-b817-4838-b7ae-a029d6a2b60e'}, 'attachment_id': '19dc3f06-4087-4bc1-93fc-06a200fe4280', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<368e18ac-eebe-44e9-a2e2-e7059dd82243> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'numa_topology' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<368e18ac-eebe-44e9-a2e2-e7059dd82243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:49:16 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:16 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'vcpu_model' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<368e18ac-eebe-44e9-a2e2-e7059dd82243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:16 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:16 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:16 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c6cbcf-fd68-4f0d-8e0d-7884a65877ca]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UgknSalT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 13:49:16 user nova-compute[87365]: node.name = iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:49:16 user nova-compute[87365]: node.tpgt = -1
Nov 08 13:49:16 user nova-compute[87365]: node.startup = automatic
Nov 08 13:49:16 user nova-compute[87365]: node.leading_login = No
Nov 08 13:49:16 user nova-compute[87365]: iface.iscsi_ifacename = default
Nov 08 13:49:16 user nova-compute[87365]: iface.net_ifacename = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.ipaddress = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.prefix_len = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.hwaddress = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.transport_name = tcp
Nov 08 13:49:16 user nova-compute[87365]: iface.initiatorname = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.vlan_id = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.vlan_priority = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.vlan_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.iface_num = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.mtu = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.port = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.bootproto = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.subnet_mask = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.gateway = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_alt_client_id = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_dns = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_learn_iqn = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_vendor_id_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_vendor_id = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.dhcp_slp_da = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.fragmentation = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.gratuitous_arp = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.incoming_forwarding = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.tos_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.tos = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.ttl = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.delayed_ack = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.tcp_nagle = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.tcp_wsf_state = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.tcp_wsf = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.tcp_timer_scale = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.tcp_timestamp = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.redirect = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.def_task_mgmt_timeout = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.header_digest = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.data_digest = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.immediate_data = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.initial_r2t = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.data_seq_inorder = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.data_pdu_inorder = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.erl = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.max_receive_data_len = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.first_burst_len = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.max_outstanding_r2t = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.max_burst_len = 0
Nov 08 13:49:16 user nova-compute[87365]: iface.chap_auth = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.bidi_chap = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.strict_login_compliance = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.discovery_auth = <empty>
Nov 08 13:49:16 user nova-compute[87365]: iface.discovery_logout = <empty>
Nov 08 13:49:16 user nova-compute[87365]: node.discovery_address = <empty>
Nov 08 13:49:16 user nova-compute[87365]: node.discovery_port = 0
Nov 08 13:49:16 user nova-compute[87365]: node.discovery_type = static
Nov 08 13:49:16 user nova-compute[87365]: node.session.initial_cmdsn = 0
Nov 08 13:49:16 user nova-compute[87365]: node.session.initial_login_retry_max = 8
Nov 08 13:49:16 user nova-compute[87365]: node.session.xmit_thread_priority = -20
Nov 08 13:49:16 user nova-compute[87365]: node.session.cmds_max = 128
Nov 08 13:49:16 user nova-compute[87365]: node.session.queue_depth = 32
Nov 08 13:49:16 user nova-compute[87365]: node.session.nr_sessions = 1
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.authmethod = CHAP
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.username = UgknSalT
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.password = ***
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.username_in = <empty>
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.password_in = <empty>
Nov 08 13:49:16 user nova-compute[87365]: node.session.auth.chap_algs = MD5
Nov 08 13:49:16 user nova-compute[87365]: node.session.timeo.replacement_timeout = 120
Nov 08 13:49:16 user nova-compute[87365]: node.session.err_timeo.abort_timeout = 15
Nov 08 13:49:16 user nova-compute[87365]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 13:49:16 user nova-compute[87365]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 13:49:16 user nova-compute[87365]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.FastAbort = Yes
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.InitialR2T = No
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.ImmediateData = Yes
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.MaxConnections = 1
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 13:49:16 user nova-compute[87365]: node.session.iscsi.ERL = 0
Nov 08 13:49:16 user nova-compute[87365]: node.session.scan = manual
Nov 08 13:49:16 user nova-compute[87365]: node.session.reopen_max = 0
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].address = 172.16.0.220
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].port = 3260
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].startup = manual
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].tcp.window_size = 524288
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].tcp.type_of_service = 0
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].timeo.logout_timeout = 15
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].timeo.login_timeout = 15
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].timeo.auth_timeout = 45
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.DataDigest = None
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.IFMarker = No
Nov 08 13:49:16 user nova-compute[87365]: node.conn[0].iscsi.OFMarker = No
Nov 08 13:49:16 user nova-compute[87365]: # END RECORD
Nov 08 13:49:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9ea0f8-12a8-4899-a617-f5c862e28234]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82855c7-de61-42d2-b2b7-7a3f82ae07ac]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgknSalT {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgknSalT" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bfb58c-2b28-4646-a962-117583e7e3e8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UgknSalT'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb5b4a1-4819-4d73-a7ae-23057ebf2852]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a48414a-5f9d-49b8-9aad-ab51c7ef142c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:16 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] HCTL ('39', '0', '0', 0) found on session 10 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eff8c1-6fbb-4a15-8b92-e790f906e227]: (4, ('0 0 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching for a device in session 10 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23665643533306137', 'path': '/dev/sdh'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665643533306137', 'path': '/dev/sdh'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1917528633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1917528633',id=15,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-0sqwha4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:47:28Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=368e18ac-eebe-44e9-a2e2-e7059dd82243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:2b:0f:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:2b:0f:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.objects.base [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<368e18ac-eebe-44e9-a2e2-e7059dd82243> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:49:16 user nova-compute[87365]:   <uuid>368e18ac-eebe-44e9-a2e2-e7059dd82243</uuid>
Nov 08 13:49:16 user nova-compute[87365]:   <name>instance-0000000f</name>
Nov 08 13:49:16 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:49:16 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:49:16 user nova-compute[87365]:   <metadata>
Nov 08 13:49:16 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:49:16 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1917528633</nova:name>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:49:16</nova:creationTime>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:49:16 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:49:16 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:owner>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:49:16 user nova-compute[87365]:       </nova:owner>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:49:16 user nova-compute[87365]:       <nova:ports>
Nov 08 13:49:16 user nova-compute[87365]:         <nova:port uuid="2f403498-6ab4-4d7e-bac9-ac06aef9a6db">
Nov 08 13:49:16 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 13:49:16 user nova-compute[87365]:         </nova:port>
Nov 08 13:49:16 user nova-compute[87365]:       </nova:ports>
Nov 08 13:49:16 user nova-compute[87365]:     </nova:instance>
Nov 08 13:49:16 user nova-compute[87365]:   </metadata>
Nov 08 13:49:16 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:49:16 user nova-compute[87365]:     <system>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="serial">368e18ac-eebe-44e9-a2e2-e7059dd82243</entry>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="uuid">368e18ac-eebe-44e9-a2e2-e7059dd82243</entry>
Nov 08 13:49:16 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:49:16 user nova-compute[87365]:     </system>
Nov 08 13:49:16 user nova-compute[87365]:   </sysinfo>
Nov 08 13:49:16 user nova-compute[87365]:   <os>
Nov 08 13:49:16 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:49:16 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:49:16 user nova-compute[87365]:   </os>
Nov 08 13:49:16 user nova-compute[87365]:   <features>
Nov 08 13:49:16 user nova-compute[87365]:     <acpi/>
Nov 08 13:49:16 user nova-compute[87365]:     <apic/>
Nov 08 13:49:16 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:49:16 user nova-compute[87365]:   </features>
Nov 08 13:49:16 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:49:16 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:49:16 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:49:16 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:49:16 user nova-compute[87365]:   </clock>
Nov 08 13:49:16 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:49:16 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:49:16 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:49:16 user nova-compute[87365]:   </cpu>
Nov 08 13:49:16 user nova-compute[87365]:   <devices>
Nov 08 13:49:16 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:49:16 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:49:16 user nova-compute[87365]:       <source dev="/dev/sdh"/>
Nov 08 13:49:16 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:49:16 user nova-compute[87365]:       <serial>06a464b2-b817-4838-b7ae-a029d6a2b60e</serial>
Nov 08 13:49:16 user nova-compute[87365]:     </disk>
Nov 08 13:49:16 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:49:16 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:49:16 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue"/>
Nov 08 13:49:16 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:49:16 user nova-compute[87365]:       <boot order="1"/>
Nov 08 13:49:16 user nova-compute[87365]:     </disk>
Nov 08 13:49:16 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:49:16 user nova-compute[87365]:       <mac address="fa:16:3e:2b:0f:e0"/>
Nov 08 13:49:16 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:16 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:49:16 user nova-compute[87365]:       <target dev="tap2f403498-6a"/>
Nov 08 13:49:16 user nova-compute[87365]:     </interface>
Nov 08 13:49:16 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:49:16 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/console.log" append="off"/>
Nov 08 13:49:16 user nova-compute[87365]:     </serial>
Nov 08 13:49:16 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:49:16 user nova-compute[87365]:     <video>
Nov 08 13:49:16 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:16 user nova-compute[87365]:     </video>
Nov 08 13:49:16 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:49:16 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:49:16 user nova-compute[87365]:     </rng>
Nov 08 13:49:16 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:49:16 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:49:16 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:49:16 user nova-compute[87365]:     </memballoon>
Nov 08 13:49:16 user nova-compute[87365]:   </devices>
Nov 08 13:49:16 user nova-compute[87365]: </domain>
Nov 08 13:49:16 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:49:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance destroyed successfully.
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:2b:0f:e0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-changed-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Refreshing instance network info cache due to event network-changed-8487e943-4746-43ff-93db-f364699a6d3c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] Acquiring lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] Acquired lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Refreshing network info cache for port 8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'flavor' on Instance uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updated VIF entry in instance network info cache for port 8487e943-4746-43ff-93db-f364699a6d3c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1fbebdd8-222e-4124-967b-d36d1c41222e req-e479ced3-e913-49f8-8a46-67c6650f5962 service nova] Releasing lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:18 user nova-compute[87365]: INFO nova.compute.manager [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Attaching volume a344022d-2014-47c0-b9dd-bef0aff0460a to /dev/vdb
Nov 08 13:49:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.utils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dc9aa2-7946-4711-a6f5-4380dea30ca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c5c38a-48d6-4489-994f-af5d83effa8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d41896-7f11-458e-8f49-651145c9676b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0331066b-5f13-4c10-99d3-2735f045733c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:49:18 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3457c7f9-b4d4-4280-9af0-81fe69947cc3]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG os_brick.utils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating existing volume attachment record: 53dba26f-3100-4e22-a8dd-532f63db9ecb {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:18 user nova-compute[87365]: WARNING nova.compute.manager [req-ed9b759b-0150-4f72-b870-3ae01a1c35f8 req-98401398-2d88-4264-8259-84b3d3a3d4aa service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state active and task_state rescuing.
Nov 08 13:49:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:49:20 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Creating image(s)
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Ensure instance console log exists: /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start _get_guest_xml network_info=[{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7487ebe0-531a-47c4-9728-3e67d9af1909', 'attached_at': '', 'detached_at': '', 'volume_id': '73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'serial': '73d2b27e-1b0c-4c12-a936-634d295ec3c6'}, 'attachment_id': '6cb3661f-93eb-45af-ba7e-d3285a8df7f7', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:49:20 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:20 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:20 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:20 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:20 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dff40b-0324-4058-b251-47625cba36ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:49:20 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd5298-86cb-41b8-b509-e9407d24309d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6] added
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a537db-2855-4917-a1b0-387f093f3681]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f4c15-c85a-40f2-aa6c-58914e45d06b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvFjKabU {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvFjKabU" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a2dc8b-1a1f-4832-9373-c220207ea5bc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvFjKabU'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bab1a8-1f95-4e0d-b884-9eb3c064e8ab]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd387ad2-4231-4818-b2fa-46ca646f854e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ffa00-3657-4286-83cc-530bb25605ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]
Nov 08 13:49:20 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78db9c70-86c4-46b4-a490-2721b26e2804]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f7b2f-08af-495a-9e4b-0123fb51dcd1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:20 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ae8be-33b5-4aa5-af85-fe6eeb13efb2]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:20 user nova-compute[87365]: WARNING nova.compute.manager [req-a0e4e525-32af-4713-aaa0-97bf3d3e1d77 req-67167f37-6da9-496b-9caf-894962437e05 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state active and task_state rescuing.
Nov 08 13:49:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9bbc7a31-ad08-454c-b98e-e98d453a4f39 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23030353034306530', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353034306530', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-679063459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lazy-loading 'pci_devices' on Instance uuid 7487ebe0-531a-47c4-9728-3e67d9af1909 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:49:21 user nova-compute[87365]:   <uuid>7487ebe0-531a-47c4-9728-3e67d9af1909</uuid>
Nov 08 13:49:21 user nova-compute[87365]:   <name>instance-00000014</name>
Nov 08 13:49:21 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:49:21 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:49:21 user nova-compute[87365]:   <metadata>
Nov 08 13:49:21 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:49:21 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:49:21 user nova-compute[87365]:       <nova:name>tempest-ServerActionsV293TestJSON-server-679063459</nova:name>
Nov 08 13:49:21 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:49:20</nova:creationTime>
Nov 08 13:49:21 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:49:21 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:49:21 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:49:21 user nova-compute[87365]:       <nova:owner>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:user uuid="23c385effdb74adbb4b090ada3770c9c">tempest-ServerActionsV293TestJSON-612073398-project-member</nova:user>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:project uuid="aa81d579f8d14baa86b0279e7cf22974">tempest-ServerActionsV293TestJSON-612073398</nova:project>
Nov 08 13:49:21 user nova-compute[87365]:       </nova:owner>
Nov 08 13:49:21 user nova-compute[87365]:       <nova:ports>
Nov 08 13:49:21 user nova-compute[87365]:         <nova:port uuid="ebc4bfed-137f-440f-8d98-792d50d2b020">
Nov 08 13:49:21 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:49:21 user nova-compute[87365]:         </nova:port>
Nov 08 13:49:21 user nova-compute[87365]:       </nova:ports>
Nov 08 13:49:21 user nova-compute[87365]:     </nova:instance>
Nov 08 13:49:21 user nova-compute[87365]:   </metadata>
Nov 08 13:49:21 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:49:21 user nova-compute[87365]:     <system>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="serial">7487ebe0-531a-47c4-9728-3e67d9af1909</entry>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="uuid">7487ebe0-531a-47c4-9728-3e67d9af1909</entry>
Nov 08 13:49:21 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:49:21 user nova-compute[87365]:     </system>
Nov 08 13:49:21 user nova-compute[87365]:   </sysinfo>
Nov 08 13:49:21 user nova-compute[87365]:   <os>
Nov 08 13:49:21 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:49:21 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:49:21 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:49:21 user nova-compute[87365]:   </os>
Nov 08 13:49:21 user nova-compute[87365]:   <features>
Nov 08 13:49:21 user nova-compute[87365]:     <acpi/>
Nov 08 13:49:21 user nova-compute[87365]:     <apic/>
Nov 08 13:49:21 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:49:21 user nova-compute[87365]:   </features>
Nov 08 13:49:21 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:49:21 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:49:21 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:49:21 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:49:21 user nova-compute[87365]:   </clock>
Nov 08 13:49:21 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:49:21 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:49:21 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:49:21 user nova-compute[87365]:   </cpu>
Nov 08 13:49:21 user nova-compute[87365]:   <devices>
Nov 08 13:49:21 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:49:21 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:49:21 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 13:49:21 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:49:21 user nova-compute[87365]:       <serial>73d2b27e-1b0c-4c12-a936-634d295ec3c6</serial>
Nov 08 13:49:21 user nova-compute[87365]:     </disk>
Nov 08 13:49:21 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:49:21 user nova-compute[87365]:       <mac address="fa:16:3e:91:49:62"/>
Nov 08 13:49:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:21 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:49:21 user nova-compute[87365]:       <target dev="tapebc4bfed-13"/>
Nov 08 13:49:21 user nova-compute[87365]:     </interface>
Nov 08 13:49:21 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:49:21 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909/console.log" append="off"/>
Nov 08 13:49:21 user nova-compute[87365]:     </serial>
Nov 08 13:49:21 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:49:21 user nova-compute[87365]:     <video>
Nov 08 13:49:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:21 user nova-compute[87365]:     </video>
Nov 08 13:49:21 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:49:21 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:49:21 user nova-compute[87365]:     </rng>
Nov 08 13:49:21 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:49:21 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:49:21 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:49:21 user nova-compute[87365]:     </memballoon>
Nov 08 13:49:21 user nova-compute[87365]:   </devices>
Nov 08 13:49:21 user nova-compute[87365]: </domain>
Nov 08 13:49:21 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-679063459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:48:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG os_vif [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddb75581-133d-5991-bb2d-7f87f019ec99', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc4bfed-13, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebc4bfed-13, col_values=(('qos', UUID('dd89f060-a4a2-4635-a384-07023e52c628')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebc4bfed-13, col_values=(('external_ids', {'iface-id': 'ebc4bfed-137f-440f-8d98-792d50d2b020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:49:62', 'vm-uuid': '7487ebe0-531a-47c4-9728-3e67d9af1909'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:21 user nova-compute[87365]: INFO os_vif [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13')
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] No VIF found with MAC fa:16:3e:91:49:62, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:23 user nova-compute[87365]: WARNING nova.compute.manager [req-25e65cc0-7142-40f3-a791-f97b10a24b3e req-05025857-f654-4663-8fa7-84d2249771c2 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state building and task_state spawning.
Nov 08 13:49:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:49:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 0 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:25 user nova-compute[87365]: WARNING nova.compute.manager [req-62058560-4356-4eda-b4a6-5c3dc14e3796 req-64819244-170a-48e2-b66b-52de608f320f service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state building and task_state spawning.
Nov 08 13:49:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:49:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance spawned successfully.
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:26 user nova-compute[87365]: INFO nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 08 13:49:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:49:26 user nova-compute[87365]: INFO nova.compute.manager [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Took 34.37 seconds to build instance.
Nov 08 13:49:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae9c1e26-6e98-43fa-a049-77146720d2d7 tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.497s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:49:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:27 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=6902MB free_disk=24.629867553710938GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f33f05cc-e996-4596-bd14-c47e64994f89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f51b5079-52de-44b5-8c51-c475e740a5a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance acf686d8-40c3-4bf1-96d2-fcb9d6cae212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e5a7bc12-2741-4ccc-98b2-98be4451aae3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:49:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:49:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.095s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:37 user nova-compute[87365]: INFO nova.compute.manager [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Terminating instance
Nov 08 13:49:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:49:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Instance destroyed successfully.
Nov 08 13:49:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lazy-loading 'resources' on Instance uuid acf686d8-40c3-4bf1-96d2-fcb9d6cae212 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785940180',display_name='tempest-VolumesActionsTest-instance-785940180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785940180',id=18,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecbc55af780947ccb2be9cc2c159d611',ramdisk_id='',reservation_id='r-93akhd50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1737829010',owner_user_name='tempest-VolumesActionsTest-1737829010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:55Z,user_data=None,user_id='79591337fdf04987a71c530710f02cb4',uuid=acf686d8-40c3-4bf1-96d2-fcb9d6cae212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converting VIF {"id": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "address": "fa:16:3e:62:63:bd", "network": {"id": "18e87346-30c7-4632-a704-3aaa2efdb3c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1074830413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecbc55af780947ccb2be9cc2c159d611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8aae6e-8d", "ovs_interfaceid": "ac8aae6e-8d90-41b4-981b-928ab3b46048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG os_vif [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac8aae6e-8d, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7b597e0-ec42-4e35-8e13-1640ddc33329) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:38 user nova-compute[87365]: INFO os_vif [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:63:bd,bridge_name='br-int',has_traffic_filtering=True,id=ac8aae6e-8d90-41b4-981b-928ab3b46048,network=Network(18e87346-30c7-4632-a704-3aaa2efdb3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8aae6e-8d')
Nov 08 13:49:38 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Deleting instance files /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212_del
Nov 08 13:49:38 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Deletion of /opt/stack/data/nova/instances/acf686d8-40c3-4bf1-96d2-fcb9d6cae212_del complete
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-unplugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] No waiting events found dispatching network-vif-unplugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-0210d19e-76a4-485c-97d7-7a4b48da5f47 req-542c48f5-c4b6-4be0-8991-62ac218fbcb2 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-unplugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:49:39 user nova-compute[87365]: INFO nova.compute.manager [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating instance_info_cache with network_info: [{"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-15d10a18-4260-481d-bdd8-ab3778293278" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:39 user nova-compute[87365]: INFO nova.compute.manager [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Terminating instance
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:39 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:39 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Took 0.93 seconds to deallocate network for instance.
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-9b34bcbe-a276-4b77-9c54-bf79ea63755f req-2c276d71-1578-4271-a7cd-17f8d6c72ada service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-deleted-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Instance destroyed successfully.
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lazy-loading 'resources' on Instance uuid f33f05cc-e996-4596-bd14-c47e64994f89 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:44:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1493447980',display_name='tempest-TestVolumeSwap-server-1493447980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1493447980',id=9,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4MRED/uRLyn4nJ4aByoghW7PPuE7eDOCUMYq5FCHE37GkfKA7ShvZV0JsvscR9KxP+Oom7sxTYDwnT2XL2Hnnx4nDAlNsW1Yz3Nxg3ygEWmmvBiUcmXRfXiFsBoPerfA==',key_name='tempest-keypair-1290437417',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e3c8d34ec3d4372af7f40af26722b86',ramdisk_id='',reservation_id='r-qlal25gn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-908946573',owner_user_name='tempest-TestVolumeSwap-908946573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='825a92c9a47d4c15a1d5da3996ce27a9',uuid=f33f05cc-e996-4596-bd14-c47e64994f89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converting VIF {"id": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "address": "fa:16:3e:77:de:e9", "network": {"id": "08d5713f-3240-4de1-a25e-be9035a46d94", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1909909848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e3c8d34ec3d4372af7f40af26722b86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcefe60-e7", "ovs_interfaceid": "fdcefe60-e73a-445e-a6b7-dbe20f600efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG os_vif [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdcefe60-e7, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfb4f07d-ea52-442e-9463-7d0eacb7fb5a) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:40 user nova-compute[87365]: INFO os_vif [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:de:e9,bridge_name='br-int',has_traffic_filtering=True,id=fdcefe60-e73a-445e-a6b7-dbe20f600efb,network=Network(08d5713f-3240-4de1-a25e-be9035a46d94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcefe60-e7')
Nov 08 13:49:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Deleting instance files /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89_del
Nov 08 13:49:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Deletion of /opt/stack/data/nova/instances/f33f05cc-e996-4596-bd14-c47e64994f89_del complete
Nov 08 13:49:40 user nova-compute[87365]: INFO nova.compute.manager [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 13:49:40 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.691s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:40 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Deleted allocations for instance acf686d8-40c3-4bf1-96d2-fcb9d6cae212
Nov 08 13:49:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-565c5d0f-8995-479b-9c7c-0c36d76d2800 tempest-VolumesActionsTest-1737829010 tempest-VolumesActionsTest-1737829010-project-member] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.052s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Acquiring lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "acf686d8-40c3-4bf1-96d2-fcb9d6cae212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] No waiting events found dispatching network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:41 user nova-compute[87365]: WARNING nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: acf686d8-40c3-4bf1-96d2-fcb9d6cae212] Received unexpected event network-vif-plugged-ac8aae6e-8d90-41b4-981b-928ab3b46048 for instance with vm_state deleted and task_state None.
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-unplugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] No waiting events found dispatching network-vif-unplugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-unplugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Acquiring lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] Lock "f33f05cc-e996-4596-bd14-c47e64994f89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] No waiting events found dispatching network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:41 user nova-compute[87365]: WARNING nova.compute.manager [req-42882dd0-8f54-4371-a38d-fa63a5004aa0 req-c9df87e9-56e9-4cda-b7ce-92b25fc14686 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received unexpected event network-vif-plugged-fdcefe60-e73a-445e-a6b7-dbe20f600efb for instance with vm_state active and task_state deleting.
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:42 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Took 1.60 seconds to deallocate network for instance.
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-b547c311-d5df-465d-b7cf-55320f52995b req-40e4830b-92cf-4eea-a2fb-f7bf5ef81028 service nova] [instance: f33f05cc-e996-4596-bd14-c47e64994f89] Received event network-vif-deleted-fdcefe60-e73a-445e-a6b7-dbe20f600efb {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.207s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:42 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:49:42 user nova-compute[87365]: INFO nova.compute.claims [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Claim successful on node user
Nov 08 13:49:42 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Deleted allocations for instance f33f05cc-e996-4596-bd14-c47e64994f89
Nov 08 13:49:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6be00e01-171f-4e70-98a2-f0b6bfee6e1e tempest-TestVolumeSwap-908946573 tempest-TestVolumeSwap-908946573-project-member] Lock "f33f05cc-e996-4596-bd14-c47e64994f89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.627s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:49:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.policy [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36139bf35e1f4f68bca23eda26b58ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa29529fcf8483ca51cc68454c9071d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:49:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Creating image(s)
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk 1073741824" returned: 0 in 0.049s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Successfully created port: da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Cannot resize image /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Ensure instance console log exists: /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Successfully updated port: da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-changed-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing instance network info cache due to event network-changed-da26a3d5-6b7b-496a-bbb9-a870e543d816. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing network info cache for port da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a8aa6f7-cab7-432a-9c27-bba2954f3b89 req-ac98d5c2-b280-43cb-9e51-a5cea064c115 service nova] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance network_info: |[{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Start _get_guest_xml network_info=[{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:49:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:49:45 user nova-compute[87365]:   <uuid>6b61eb52-9ddd-4948-a037-4db6d2d779e6</uuid>
Nov 08 13:49:45 user nova-compute[87365]:   <name>instance-00000015</name>
Nov 08 13:49:45 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:49:45 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:49:45 user nova-compute[87365]:   <metadata>
Nov 08 13:49:45 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:49:45 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:name>tempest-device-tagging-server-401134231</nova:name>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:49:45</nova:creationTime>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:49:45 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:49:45 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:owner>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:user uuid="36139bf35e1f4f68bca23eda26b58ed8">tempest-TaggedAttachmentsTest-1724451289-project-member</nova:user>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:project uuid="daa29529fcf8483ca51cc68454c9071d">tempest-TaggedAttachmentsTest-1724451289</nova:project>
Nov 08 13:49:45 user nova-compute[87365]:       </nova:owner>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:49:45 user nova-compute[87365]:       <nova:ports>
Nov 08 13:49:45 user nova-compute[87365]:         <nova:port uuid="da26a3d5-6b7b-496a-bbb9-a870e543d816">
Nov 08 13:49:45 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:49:45 user nova-compute[87365]:         </nova:port>
Nov 08 13:49:45 user nova-compute[87365]:       </nova:ports>
Nov 08 13:49:45 user nova-compute[87365]:     </nova:instance>
Nov 08 13:49:45 user nova-compute[87365]:   </metadata>
Nov 08 13:49:45 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:49:45 user nova-compute[87365]:     <system>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="serial">6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="uuid">6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:49:45 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:49:45 user nova-compute[87365]:     </system>
Nov 08 13:49:45 user nova-compute[87365]:   </sysinfo>
Nov 08 13:49:45 user nova-compute[87365]:   <os>
Nov 08 13:49:45 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:49:45 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:49:45 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:49:45 user nova-compute[87365]:   </os>
Nov 08 13:49:45 user nova-compute[87365]:   <features>
Nov 08 13:49:45 user nova-compute[87365]:     <acpi/>
Nov 08 13:49:45 user nova-compute[87365]:     <apic/>
Nov 08 13:49:45 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:49:45 user nova-compute[87365]:   </features>
Nov 08 13:49:45 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:49:45 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:49:45 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:49:45 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:49:45 user nova-compute[87365]:   </clock>
Nov 08 13:49:45 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:49:45 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:49:45 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:49:45 user nova-compute[87365]:   </cpu>
Nov 08 13:49:45 user nova-compute[87365]:   <devices>
Nov 08 13:49:45 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:49:45 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:49:45 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk"/>
Nov 08 13:49:45 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:49:45 user nova-compute[87365]:     </disk>
Nov 08 13:49:45 user nova-compute[87365]:     <disk type="file" device="cdrom">
Nov 08 13:49:45 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 13:49:45 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config"/>
Nov 08 13:49:45 user nova-compute[87365]:       <target dev="hda" bus="ide"/>
Nov 08 13:49:45 user nova-compute[87365]:     </disk>
Nov 08 13:49:45 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:49:45 user nova-compute[87365]:       <mac address="fa:16:3e:3b:6a:39"/>
Nov 08 13:49:45 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:45 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:49:45 user nova-compute[87365]:       <target dev="tapda26a3d5-6b"/>
Nov 08 13:49:45 user nova-compute[87365]:     </interface>
Nov 08 13:49:45 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:49:45 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log" append="off"/>
Nov 08 13:49:45 user nova-compute[87365]:     </serial>
Nov 08 13:49:45 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:49:45 user nova-compute[87365]:     <video>
Nov 08 13:49:45 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:49:45 user nova-compute[87365]:     </video>
Nov 08 13:49:45 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:49:45 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:49:45 user nova-compute[87365]:     </rng>
Nov 08 13:49:45 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:49:45 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:49:45 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:49:45 user nova-compute[87365]:     </memballoon>
Nov 08 13:49:45 user nova-compute[87365]:   </devices>
Nov 08 13:49:45 user nova-compute[87365]: </domain>
Nov 08 13:49:45 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG os_vif [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0555f189-3d6d-5086-823e-c91c6f72e5a8', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda26a3d5-6b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda26a3d5-6b, col_values=(('qos', UUID('82cef190-8294-48d1-8751-cb2525b3cfb5')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda26a3d5-6b, col_values=(('external_ids', {'iface-id': 'da26a3d5-6b7b-496a-bbb9-a870e543d816', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:6a:39', 'vm-uuid': '6b61eb52-9ddd-4948-a037-4db6d2d779e6'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:45 user nova-compute[87365]: INFO os_vif [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b')
Nov 08 13:49:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name hda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No VIF found with MAC fa:16:3e:3b:6a:39, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:49:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Using config drive
Nov 08 13:49:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Creating config drive at /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config
Nov 08 13:49:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvqe13qvb {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvqe13qvb" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuKxHFaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:47 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d448282-8941-429b-a88b-a21a12f617bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:49:47 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f02c4-9c97-4a8d-ad6d-f96714387490]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a] added
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a35a78e-c25e-46a4-aeb4-05ee2dcf164a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d76357-c6d6-4e5c-bbfe-3816fada1db8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuKxHFaQ {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuKxHFaQ" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[841679d6-1a38-4be5-8099-1b691382aa97]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OuKxHFaQ'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aff083-102f-4728-99ba-245f89a6412e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c348d-b8a5-4614-98e1-7ce315a2bf62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[22127b71-9111-4d37-a65a-6b7456469a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260]
Nov 08 13:49:47 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260] successful.
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa34f1-3654-49cf-bf9a-bfbaf55cd5b4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c634eff-2b81-42a9-8836-fd53b3f31e85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:47 user nova-compute[87365]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)
Nov 08 13:49:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3159d-4040-451d-9bd4-5622cda2e660]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuKxHFaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:47 user nova-compute[87365]: WARNING nova.compute.manager [req-686f4b57-47e9-4a3f-969d-2c07f7c24a2a req-aa6ef33c-da54-43cf-b23e-55520ad5cdee service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 for instance with vm_state building and task_state spawning.
Nov 08 13:49:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23039306131356166', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039306131356166', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG nova.objects.instance [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'flavor' on Instance uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:49:48 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:49:48 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:49:48 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:49:48 user nova-compute[87365]:   <serial>a344022d-2014-47c0-b9dd-bef0aff0460a</serial>
Nov 08 13:49:48 user nova-compute[87365]: </disk>
Nov 08 13:49:48 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No VIF found with MAC fa:16:3e:bf:dc:3f, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-defafab3-9571-44c2-91a5-63e12430027e tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.459s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:49 user nova-compute[87365]: WARNING nova.compute.manager [req-e2f0b92e-7468-435e-a4a8-7a8a9798310a req-703d1f16-e747-4634-a46f-f1101492d2a2 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 for instance with vm_state building and task_state spawning.
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:49:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance spawned successfully.
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:49:50 user nova-compute[87365]: INFO nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 08 13:49:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:49:50 user nova-compute[87365]: INFO nova.compute.manager [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Took 8.05 seconds to build instance.
Nov 08 13:49:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9364cafb-62ce-4469-b7f6-0af77500d3af tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.263s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:51 user nova-compute[87365]: INFO nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Rebuilding instance
Nov 08 13:49:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:52 user nova-compute[87365]: WARNING nova.compute.manager [req-e3330eaf-28d5-4221-adef-3f36e8e37f79 req-7802a081-2b19-4cfe-a72a-05e5dc210a8d service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance destroyed successfully.
Nov 08 13:49:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:53 user nova-compute[87365]: INFO nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Detaching volume a344022d-2014-47c0-b9dd-bef0aff0460a
Nov 08 13:49:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:53 user nova-compute[87365]: INFO nova.virt.block_device [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Attempting to driver detach volume a344022d-2014-47c0-b9dd-bef0aff0460a from mountpoint /dev/vdb
Nov 08 13:49:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Attempting to detach device vdb from instance 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:49:53 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:49:53 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:49:53 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:49:53 user nova-compute[87365]:   <serial>a344022d-2014-47c0-b9dd-bef0aff0460a</serial>
Nov 08 13:49:53 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:49:53 user nova-compute[87365]: </disk>
Nov 08 13:49:53 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:49:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully detached device vdb from instance 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 from the persistent domain config.
Nov 08 13:49:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuKxHFaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:53 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6de0e-4b96-442a-ae23-94be6acdd958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:49:53 user nova-compute[87365]: No targets found.
Nov 08 13:49:53 user nova-compute[87365]: iSNS:
Nov 08 13:49:53 user nova-compute[87365]: No targets found.
Nov 08 13:49:53 user nova-compute[87365]: STATIC:
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:49:53 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:53 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:53 user nova-compute[87365]: FIRMWARE:
Nov 08 13:49:53 user nova-compute[87365]: No targets found.
Nov 08 13:49:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:49:53 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:49:53 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c281b-60f1-4b30-b1b7-674a1a3995c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[476b462a-6609-45d9-b774-c50491e2a71a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)
Nov 08 13:49:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:53 user nova-compute[87365]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a (non-flash)
Nov 08 13:49:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d1c3d05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf923a53-c2ee-4155-944f-eeb30777e90b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3615ce85-d100-4dd3-9c43-c09ac4a3f979]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6fc20-6401-4916-9e29-38e55c2e1882]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[458930ee-4bdc-40f6-bec2-b667ca1820e0]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfbbbfd-7c35-4d1d-a980-998984229231]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee77f9-5e65-4341-867a-936f6b754a6b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260]
Nov 08 13:49:53 user nova-compute[87365]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a, portal: 172.16.0.220,3260] successful.
Nov 08 13:49:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd8e388-e1a9-4197-b6fb-ee94e2190abe]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== disconnect_volume: return (456ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:54 user nova-compute[87365]: WARNING nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:54 user nova-compute[87365]: WARNING nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:54 user nova-compute[87365]: WARNING nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:54 user nova-compute[87365]: WARNING nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-unplugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] No waiting events found dispatching network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:54 user nova-compute[87365]: WARNING nova.compute.manager [req-e9973eed-478e-4f8a-b496-21f0e4599cd2 req-7fb20427-287f-4a05-aa77-1c1c567fb247 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received unexpected event network-vif-plugged-8487e943-4746-43ff-93db-f364699a6d3c for instance with vm_state active and task_state rebuilding.
Nov 08 13:49:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance destroyed successfully.
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-978346557',display_name='tempest-ServerActionsTestOtherA-server-717355324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-978346557',id=16,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXssOCN6l/BHRW8eYhwE/+KFpIm6yZAz+7PkYmeevUzCp4InPVQp+u9pz8vhJDmHM4iGSRQguFaolJQxr0wTymCCCouBr7rmsCpZbHhdxLPc17+hEnzAvYx6PBQWGBzRQ==',key_name='tempest-keypair-1114508957',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-vdqtxa2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=7f48b991-bd55-400d-ac6a-5ed4f976b6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_vif [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8487e943-47, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9efd3603-d98a-430a-b099-c5d7c9a23d80) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:55 user nova-compute[87365]: INFO os_vif [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47')
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuKxHFaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:55 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eaa627-aaf9-47a1-b6d0-d291f084f066]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:49:55 user nova-compute[87365]: No targets found.
Nov 08 13:49:55 user nova-compute[87365]: iSNS:
Nov 08 13:49:55 user nova-compute[87365]: No targets found.
Nov 08 13:49:55 user nova-compute[87365]: STATIC:
Nov 08 13:49:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106
Nov 08 13:49:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:49:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:49:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:49:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:49:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:49:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:49:55 user nova-compute[87365]: FIRMWARE:
Nov 08 13:49:55 user nova-compute[87365]: No targets found.
Nov 08 13:49:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:49:55 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:49:55 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d965a-c818-4646-978c-c76faec27997]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[73288866-9abd-4fd7-a581-a63444c61bb2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:49:55 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:49:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef1360>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== disconnect_volume: return (84ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:49:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Deleting instance files /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0_del
Nov 08 13:49:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Deletion of /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0_del complete
Nov 08 13:49:55 user nova-compute[87365]: INFO nova.virt.block_device [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Booting with volume a344022d-2014-47c0-b9dd-bef0aff0460a at /dev/vdb
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.utils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd8b6be-89a2-4206-98fe-a25a17af89fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd238ea-5894-4c90-8c31-3893c480785c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea53e96-cc7b-42d6-828d-5bbd5a010d0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af1ada-7588-4e2d-aad5-3dd5d79b2021]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:49:55 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:49:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a13b8-ecaa-40b1-8924-7e54615c8108]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG os_brick.utils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating existing volume attachment record: 86c85db7-7cf1-4ba2-875a-203e3f638c48 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:49:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:56 user nova-compute[87365]: INFO nova.compute.manager [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Terminating instance
Nov 08 13:49:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-unplugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] No waiting events found dispatching network-vif-unplugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-b79d506a-5c9f-4641-9cb6-af979c159d31 req-eb96f44a-7116-4c46-acf9-286a9ce8b4ba service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-unplugged-daf49e96-476e-4a21-a80f-a192b67afc32 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Instance destroyed successfully.
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.objects.instance [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'resources' on Instance uuid f51b5079-52de-44b5-8c51-c475e740a5a7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1057702666',display_name='tempest-VolumesAdminNegativeTest-server-1057702666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1057702666',id=17,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-pp3f3349',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:47:55Z,user_data=None,user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=f51b5079-52de-44b5-8c51-c475e740a5a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "daf49e96-476e-4a21-a80f-a192b67afc32", "address": "fa:16:3e:7a:c6:ce", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf49e96-47", "ovs_interfaceid": "daf49e96-476e-4a21-a80f-a192b67afc32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG os_vif [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaf49e96-47, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6315092-8d75-4be6-a102-355250f8fea8) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:49:57 user nova-compute[87365]: INFO os_vif [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:c6:ce,bridge_name='br-int',has_traffic_filtering=True,id=daf49e96-476e-4a21-a80f-a192b67afc32,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf49e96-47')
Nov 08 13:49:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Deleting instance files /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7_del
Nov 08 13:49:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Deletion of /opt/stack/data/nova/instances/f51b5079-52de-44b5-8c51-c475e740a5a7_del complete
Nov 08 13:49:57 user nova-compute[87365]: INFO nova.compute.manager [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 13:49:57 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:49:57 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:58 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Took 0.77 seconds to deallocate network for instance.
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-2f37dcab-1198-41ea-bf36-f9a77d0da64d req-50abb068-a393-4106-98e8-21dfefddd5c5 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-deleted-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:58 user nova-compute[87365]: INFO nova.compute.manager [req-2f37dcab-1198-41ea-bf36-f9a77d0da64d req-50abb068-a393-4106-98e8-21dfefddd5c5 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Neutron deleted interface daf49e96-476e-4a21-a80f-a192b67afc32; detaching it from the instance and deleting it from the info cache
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.network.neutron [req-2f37dcab-1198-41ea-bf36-f9a77d0da64d req-50abb068-a393-4106-98e8-21dfefddd5c5 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-2f37dcab-1198-41ea-bf36-f9a77d0da64d req-50abb068-a393-4106-98e8-21dfefddd5c5 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Detach interface failed, port_id=daf49e96-476e-4a21-a80f-a192b67afc32, reason: Instance f51b5079-52de-44b5-8c51-c475e740a5a7 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:49:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:49:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] Acquiring lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:49:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:49:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:49:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] No waiting events found dispatching network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:49:59 user nova-compute[87365]: WARNING nova.compute.manager [req-3f5778d8-70b0-4843-b5a2-9d2b62eca91d req-e8ec8177-f3af-43c8-bbce-98af7e20d6c1 service nova] [instance: f51b5079-52de-44b5-8c51-c475e740a5a7] Received unexpected event network-vif-plugged-daf49e96-476e-4a21-a80f-a192b67afc32 for instance with vm_state deleted and task_state None.
Nov 08 13:49:59 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Deleted allocations for instance f51b5079-52de-44b5-8c51-c475e740a5a7
Nov 08 13:49:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-acf6f01b-242c-4b3d-a467-ca568d618a8e tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "f51b5079-52de-44b5-8c51-c475e740a5a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-changed-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing instance network info cache due to event network-changed-fa99f959-b5cf-4f15-9aec-60884cb6a997. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] Acquiring lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] Acquired lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Refreshing network info cache for port fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updated VIF entry in instance network info cache for port fa99f959-b5cf-4f15-9aec-60884cb6a997. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:50:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b2cf9fc1-f55d-45d4-aaf1-684ad7c262f2 req-e91c44c2-7ee0-4413-954e-8b888b973761 service nova] Releasing lock "refresh_cache-4c7e345e-69ff-421a-b79c-e6efa33ca95d" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:50:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:04 user nova-compute[87365]: INFO nova.compute.manager [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Terminating instance
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5da5a61-c62d-402d-b639-6bfc4526648a req-93226eda-4c0f-40d7-91a7-0791c09d8fb2 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-6caf8892-5ad3-4142-a847-9040e1f1b406 req-eb91d4d6-e1f9-4a14-84e9-25e2f8ce3f68 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-12f689fe-2af5-4edb-a405-742859e76b3c for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2bb2a7a-d22f-450e-801e-205e6fee8bc9 req-89ca4fc4-81f1-483b-9a45-0a136eada974 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-98b64a69-dc60-4118-89bc-2694600d9bbe for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Instance destroyed successfully.
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lazy-loading 'resources' on Instance uuid 4c7e345e-69ff-421a-b79c-e6efa33ca95d {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa99f959-b5, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=871904b5-c815-4bb5-b901-1bec8e0734e8) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: WARNING nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-fa99f959-b5cf-4f15-9aec-60884cb6a997 for instance with vm_state active and task_state deleting.
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: WARNING nova.compute.manager [req-715a1320-4f0c-47f3-9bff-d3f7b58bf51b req-41545f89-9b1e-459d-8816-596736e7fa1d service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-edbfd8ac-b523-4e52-9860-28d483b6fd29 for instance with vm_state active and task_state deleting.
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:86:db,bridge_name='br-int',has_traffic_filtering=True,id=fa99f959-b5cf-4f15-9aec-60884cb6a997,network=Network(45b6d501-f56c-4b3e-8c5d-1d02cad676bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa99f959-b5')
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedbfd8ac-b5, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51820447-fd0a-462f-ae85-38c2a974d418) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fd:33,bridge_name='br-int',has_traffic_filtering=True,id=edbfd8ac-b523-4e52-9860-28d483b6fd29,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedbfd8ac-b5')
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12f689fe-2a, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8204b73d-ba83-4c88-8384-a1c632019455) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: WARNING nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-12f689fe-2af5-4edb-a405-742859e76b3c for instance with vm_state active and task_state deleting.
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:06 user nova-compute[87365]: WARNING nova.compute.manager [req-5f9c61d3-30f0-42a4-84ba-436debccc2ea req-8f9d8401-4841-4968-8066-deb730984fc8 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-10643c61-1acb-4bcd-ace5-5b4b5204d871 for instance with vm_state active and task_state deleting.
Nov 08 13:50:06 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2b:17,bridge_name='br-int',has_traffic_filtering=True,id=12f689fe-2af5-4edb-a405-742859e76b3c,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap12f689fe-2a')
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98b64a69-dc, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddb0c1c0-6464-45c7-a6e7-9439fc627d64) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f8:a5,bridge_name='br-int',has_traffic_filtering=True,id=98b64a69-dc60-4118-89bc-2694600d9bbe,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b64a69-dc')
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34759ed9-3c, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=042a88cd-b98f-4624-b31d-bfa61dd1ed20) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:dd:e3,bridge_name='br-int',has_traffic_filtering=True,id=34759ed9-3ca9-43ca-a427-f6202da5368a,network=Network(114d56a5-b33d-4b3b-8e31-6850ffac1d2a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34759ed9-3c')
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "address": "fa:16:3e:f3:6d:2d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10643c61-1a", "ovs_interfaceid": "10643c61-1acb-4bcd-ace5-5b4b5204d871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-98b64a69-dc60-4118-89bc-2694600d9bbe for instance with vm_state active and task_state deleting.
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-34759ed9-3ca9-43ca-a427-f6202da5368a for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-34759ed9-3ca9-43ca-a427-f6202da5368a for instance with vm_state active and task_state deleting.
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-unplugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-unplugged-2ec10073-2ba4-4a46-84cb-c432b524b85b for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] No waiting events found dispatching network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3eae8a-e7a7-4c6b-8a72-b803060d3fba req-1b79fe01-880b-4143-9c73-fda7bce53098 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received unexpected event network-vif-plugged-2ec10073-2ba4-4a46-84cb-c432b524b85b for instance with vm_state active and task_state deleting.
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10643c61-1a, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2cb8806-eff5-4a82-a4d0-224d1fbadd60) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:2d,bridge_name='br-int',has_traffic_filtering=True,id=10643c61-1acb-4bcd-ace5-5b4b5204d871,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10643c61-1a')
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1151537456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1151537456',id=14,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeGYgcr4klCe/KZ/ns/sqv3Kzx/w5W+oKBqLKfIl61BeiJtVtbBS3KCOKkT8lPJgParzcWRf0p4aZN1+G9kJWiFI43jSOs4v3jgkFZzjczW88LY6lMvIxmAWSAp1JhFHg==',key_name='tempest-keypair-362699929',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc866ab8a5c04f8697b04aef5c329c25',ramdisk_id='',reservation_id='r-c4f264r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-370745883',owner_user_name='tempest-TaggedBootDevicesTest_v242-370745883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55bd41d1019d482daeddf21aa8c4080e',uuid=4c7e345e-69ff-421a-b79c-e6efa33ca95d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converting VIF {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ec10073-2b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ead37f39-9b01-4290-a405-27a4afd5dc4d) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:07 user nova-compute[87365]: INFO os_vif [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7e:9d,bridge_name='br-int',has_traffic_filtering=True,id=2ec10073-2ba4-4a46-84cb-c432b524b85b,network=Network(5a934dbe-2e8e-46e9-805e-534c31bca1c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec10073-2b')
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yApTmgUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3307e3-c5fe-4f24-95bd-0904e0c4011d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: iSNS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: STATIC:
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: FIRMWARE:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:50:07 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb2019-4d47-4683-9808-050df309a442]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a031531-067e-4bbf-a09b-e224dcf61535]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a9ebaf-1f32-4892-849e-a60d00f31c31]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecca6d53-1d09-48f5-89ca-e23a881e8b46]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e723f6-f1c3-4fba-8169-f0c298e498cd]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ed4a4-7225-4c0a-8e3a-a13c1b1bc3b9]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d6d4f-6db0-48f4-83fa-632d8a40a5c3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf248a-256c-428c-82cd-5a4e146081c8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260]
Nov 08 13:50:07 user nova-compute[87365]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106, portal: 172.16.0.220,3260] successful.
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adfd1674-c9ea-419d-9e2d-f376eb8bb106 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[309458fe-a5e5-4660-9d2d-0789615a1de2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== disconnect_volume: return (341ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tobPrqEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203da06-8773-4c92-a03e-2582a0c77323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: iSNS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: STATIC:
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: FIRMWARE:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:50:07 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da08fe4-0d20-4702-ade0-4106e2e4e8f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d8db13-ab92-4f6f-a9b4-05004fa46d97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a97d3e-7ce7-4494-822e-23735d0972df]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a46f5-e59d-4fd4-b9a6-ea8052cd9653]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f96ac1-77c9-4e2e-8982-e29469e853e9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc050c6-de32-4f12-97a1-2b9a229474f9]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2a0fa-3ecb-43c8-88f9-ca03798f7c3a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187316b-9bdb-4d6a-b142-604d0c4aed20]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260]
Nov 08 13:50:07 user nova-compute[87365]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b, portal: 172.16.0.220,3260] successful.
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f10e358-0661-4612-a6f1-6d9b2d55c82b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82771b7-2793-4397-a461-484c2cd21104]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== disconnect_volume: return (319ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SpdLCvHV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:50:07 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0621a70-9f9a-4bad-b7aa-f7f7ef0dc30d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: iSNS:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]: STATIC:
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b
Nov 08 13:50:07 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:07 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:07 user nova-compute[87365]: FIRMWARE:
Nov 08 13:50:07 user nova-compute[87365]: No targets found.
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:50:07 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:50:07 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77faf6-fd29-4f38-b135-00c8dadeb967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b40106-976c-4173-86be-904aeb4d873f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b (non-flash)
Nov 08 13:50:07 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:07 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb6a9ed-a33c-4410-ab74-0fe517aba992]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56f1c0-f0de-4038-bb5d-063ddc607524]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539853b-0bc6-4a96-a04f-3bae275282ff]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f16aef-642a-4213-90da-564f7331bfb6]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7febe-39fa-4126-91c9-95bac4c89cf6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[693faf7f-6b6d-4a38-837c-ac7beb73d4f5]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260]
Nov 08 13:50:08 user nova-compute[87365]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b, portal: 172.16.0.220,3260] successful.
Nov 08 13:50:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a404af20-3cc6-4a6f-8d8f-82728700f86b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce838bc4-ceb9-41f4-9fd5-a05ec8974e36]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] <== disconnect_volume: return (314ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:50:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Deleting instance files /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d_del
Nov 08 13:50:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Deletion of /opt/stack/data/nova/instances/4c7e345e-69ff-421a-b79c-e6efa33ca95d_del complete
Nov 08 13:50:08 user nova-compute[87365]: INFO nova.compute.manager [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Took 4.04 seconds to destroy the instance on the hypervisor.
Nov 08 13:50:08 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:50:08 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:09 user nova-compute[87365]: WARNING nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid b3bc6678-0f78-4778-9a0d-95e0a7c3e690 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 78bf22ef-27da-4b43-9da9-37de97525acc {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 4c7e345e-69ff-421a-b79c-e6efa33ca95d {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid e5a7bc12-2741-4ccc-98b2-98be4451aae3 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 7487ebe0-531a-47c4-9728-3e67d9af1909 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e463755-0711-4a6f-96c8-5da935ab211b req-b10fcb98-dd1e-4b82-8ce3-d75b086bc93f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-deleted-10643c61-1acb-4bcd-ace5-5b4b5204d871 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:09 user nova-compute[87365]: INFO nova.compute.manager [req-1e463755-0711-4a6f-96c8-5da935ab211b req-b10fcb98-dd1e-4b82-8ce3-d75b086bc93f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Neutron deleted interface 10643c61-1acb-4bcd-ace5-5b4b5204d871; detaching it from the instance and deleting it from the info cache
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-1e463755-0711-4a6f-96c8-5da935ab211b req-b10fcb98-dd1e-4b82-8ce3-d75b086bc93f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98b64a69-dc60-4118-89bc-2694600d9bbe", "address": "fa:16:3e:33:f8:a5", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b64a69-dc", "ovs_interfaceid": "98b64a69-dc60-4118-89bc-2694600d9bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:09 user nova-compute[87365]: WARNING oslo_messaging._drivers.amqpdriver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e463755-0711-4a6f-96c8-5da935ab211b req-b10fcb98-dd1e-4b82-8ce3-d75b086bc93f service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Detach interface failed, port_id=10643c61-1acb-4bcd-ace5-5b4b5204d871, reason: Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:50:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:11 user nova-compute[87365]: INFO nova.compute.manager [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Unrescuing
Nov 08 13:50:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG nova.objects.instance [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'flavor' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-deleted-98b64a69-dc60-4118-89bc-2694600d9bbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:12 user nova-compute[87365]: INFO nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Neutron deleted interface 98b64a69-dc60-4118-89bc-2694600d9bbe; detaching it from the instance and deleting it from the info cache
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34759ed9-3ca9-43ca-a427-f6202da5368a", "address": "fa:16:3e:b8:dd:e3", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34759ed9-3c", "ovs_interfaceid": "34759ed9-3ca9-43ca-a427-f6202da5368a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Detach interface failed, port_id=98b64a69-dc60-4118-89bc-2694600d9bbe, reason: Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-deleted-34759ed9-3ca9-43ca-a427-f6202da5368a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:12 user nova-compute[87365]: INFO nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Neutron deleted interface 34759ed9-3ca9-43ca-a427-f6202da5368a; detaching it from the instance and deleting it from the info cache
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "address": "fa:16:3e:51:7e:9d", "network": {"id": "5a934dbe-2e8e-46e9-805e-534c31bca1c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1029459226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec10073-2b", "ovs_interfaceid": "2ec10073-2ba4-4a46-84cb-c432b524b85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Detach interface failed, port_id=34759ed9-3ca9-43ca-a427-f6202da5368a, reason: Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-deleted-2ec10073-2ba4-4a46-84cb-c432b524b85b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:12 user nova-compute[87365]: INFO nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Neutron deleted interface 2ec10073-2ba4-4a46-84cb-c432b524b85b; detaching it from the instance and deleting it from the info cache
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [{"id": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "address": "fa:16:3e:79:86:db", "network": {"id": "45b6d501-f56c-4b3e-8c5d-1d02cad676bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1205120143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa99f959-b5", "ovs_interfaceid": "fa99f959-b5cf-4f15-9aec-60884cb6a997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "address": "fa:16:3e:05:fd:33", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbfd8ac-b5", "ovs_interfaceid": "edbfd8ac-b523-4e52-9860-28d483b6fd29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "12f689fe-2af5-4edb-a405-742859e76b3c", "address": "fa:16:3e:db:2b:17", "network": {"id": "114d56a5-b33d-4b3b-8e31-6850ffac1d2a", "bridge": "br-int", "label": "tempest-device-tagging-net1-943524399", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dc866ab8a5c04f8697b04aef5c329c25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f689fe-2a", "ovs_interfaceid": "12f689fe-2af5-4edb-a405-742859e76b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-b5804af7-80a9-4f9c-9298-2f30b01b2ee1 req-e15bb9ec-14b0-4934-8028-ebc2e786254c service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Detach interface failed, port_id=2ec10073-2ba4-4a46-84cb-c432b524b85b, reason: Instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:12 user nova-compute[87365]: WARNING nova.compute.manager [req-2311c7fd-5ea5-4516-9589-526347f01bd3 req-ef58232f-c72b-4701-9c0e-466574ddf49c service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:50:12 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:12 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Took 4.16 seconds to deallocate network for instance.
Nov 08 13:50:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance destroyed successfully.
Nov 08 13:50:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-a41f7056-71f3-4b8c-a944-1368cf37597b req-6db180ce-6e1e-421b-a3b3-068bd36a39e1 service nova] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Received event network-vif-deleted-fa99f959-b5cf-4f15-9aec-60884cb6a997 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:14 user nova-compute[87365]: WARNING nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:50:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:14 user nova-compute[87365]: WARNING nova.compute.manager [req-1e46152e-6775-4c73-a925-1fb6bcd02254 req-47426d88-baed-4b6c-8c2a-4d5ccb273110 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:50:15 user nova-compute[87365]: INFO nova.compute.manager [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] Took 3.04 seconds to detach 3 volumes for instance.
Nov 08 13:50:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.volume.cinder [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Update attachment failed for attachment 86c85db7-7cf1-4ba2-875a-203e3f638c48. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Traceback (most recent call last):
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self.driver.rebuild(**kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise NotImplementedError()
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] NotImplementedError
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During handling of the above exception, another exception occurred:
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Traceback (most recent call last):
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     driver_block_device.attach_block_devices(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     _log_and_attach(device)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._do_attach(context, instance, volume, volume_api,
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._volume_attach(context, volume, connector, instance,
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     connection_info = volume_api.attachment_update(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     res = method(self, ctx, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     with excutils.save_and_reraise_exception():
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self.force_reraise()
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise self.value
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return method.func(obj, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     resp = self._update('/attachments/%s' % id, body)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return self.request(url, method, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise exceptions.from_response(resp, body)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:50:15 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:50:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:15 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Deleted allocations for instance 4c7e345e-69ff-421a-b79c-e6efa33ca95d
Nov 08 13:50:15 user nova-compute[87365]: DEBUG nova.compute.utils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e) {{(pid=87365) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Traceback (most recent call last):
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self.driver.rebuild(**kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise NotImplementedError()
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] NotImplementedError
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During handling of the above exception, another exception occurred:
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Traceback (most recent call last):
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     driver_block_device.attach_block_devices(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     _log_and_attach(device)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._do_attach(context, instance, volume, volume_api,
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._volume_attach(context, volume, connector, instance,
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     connection_info = volume_api.attachment_update(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     res = method(self, ctx, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     with excutils.save_and_reraise_exception():
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self.force_reraise()
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise self.value
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return method.func(obj, *args, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     resp = self._update('/attachments/%s' % id, body)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     return self.request(url, method, **kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise exceptions.from_response(resp, body)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During handling of the above exception, another exception occurred:
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Traceback (most recent call last):
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     yield
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._do_rebuild_instance_with_claim(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._do_rebuild_instance(
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     self._rebuild_default_impl(**kwargs)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0]     raise exception.InvalidBDM(str(ex))
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] 
Nov 08 13:50:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6d1d055-ba09-4f9c-8599-d25ca262d0fb tempest-TaggedBootDevicesTest_v242-370745883 tempest-TaggedBootDevicesTest_v242-370745883-project-member] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.916s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.143s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:16 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 4c7e345e-69ff-421a-b79c-e6efa33ca95d] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "4c7e345e-69ff-421a-b79c-e6efa33ca95d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0668624b-b723-46f4-b029-249688b2c9e1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:16 user nova-compute[87365]: WARNING nova.compute.manager [req-dc9dd560-adbd-4a23-a9de-784f8f6b711c req-8eb89779-c665-44d5-8f72-a9170c6ea1ab service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state active and task_state None.
Nov 08 13:50:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:16 user nova-compute[87365]: INFO nova.compute.manager [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-19ece5d6-af47-45de-9c06-187535b09b03 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-21154c89-8630-4ceb-bcb6-31c0ad90ec9e)
Nov 08 13:50:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:50:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:24 user nova-compute[87365]: INFO nova.compute.manager [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Terminating instance
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-unplugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] No waiting events found dispatching network-vif-unplugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-aadcb377-aa12-4a89-8f16-59d2538d4595 req-9987318d-4292-48d8-81d0-21d5d9461f6d service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-unplugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Instance destroyed successfully.
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lazy-loading 'resources' on Instance uuid e5a7bc12-2741-4ccc-98b2-98be4451aae3 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-673889953',display_name='tempest-VolumesActionsTest-instance-673889953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-673889953',id=19,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4647686e56564f89bacdec5e20e47d2a',ramdisk_id='',reservation_id='r-05qsvd9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1471425088',owner_user_name='tempest-VolumesActionsTest-1471425088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:48:22Z,user_data=None,user_id='bfb0a0d029584372a281f2deb15c1ec2',uuid=e5a7bc12-2741-4ccc-98b2-98be4451aae3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converting VIF {"id": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "address": "fa:16:3e:ed:f3:fa", "network": {"id": "a14e33cc-04ab-4ae3-8b3e-04894248ba5e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-859780152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4647686e56564f89bacdec5e20e47d2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b16b74b-85", "ovs_interfaceid": "8b16b74b-85f1-4fd3-b217-059cf6305f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG os_vif [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b16b74b-85, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aaef4f3-aa28-43c8-aa8e-eb5a7fbaa11c) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:24 user nova-compute[87365]: INFO os_vif [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=8b16b74b-85f1-4fd3-b217-059cf6305f21,network=Network(a14e33cc-04ab-4ae3-8b3e-04894248ba5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b16b74b-85')
Nov 08 13:50:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Deleting instance files /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3_del
Nov 08 13:50:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Deletion of /opt/stack/data/nova/instances/e5a7bc12-2741-4ccc-98b2-98be4451aae3_del complete
Nov 08 13:50:24 user nova-compute[87365]: INFO nova.compute.manager [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 08 13:50:24 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:50:24 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:50:25 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:25 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Took 0.40 seconds to deallocate network for instance.
Nov 08 13:50:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:25 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:50:25 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:50:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:25 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Deleted allocations for instance e5a7bc12-2741-4ccc-98b2-98be4451aae3
Nov 08 13:50:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cdab4108-8595-4aa6-80de-9f6a0837e9b5 tempest-VolumesActionsTest-1471425088 tempest-VolumesActionsTest-1471425088-project-member] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.593s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] Acquiring lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] Lock "e5a7bc12-2741-4ccc-98b2-98be4451aae3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] No waiting events found dispatching network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:26 user nova-compute[87365]: WARNING nova.compute.manager [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received unexpected event network-vif-plugged-8b16b74b-85f1-4fd3-b217-059cf6305f21 for instance with vm_state deleted and task_state None.
Nov 08 13:50:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-785106ed-98bc-44d6-aa2d-e4f52e193c90 req-e4b44b2d-1752-4066-ab9b-db3db8b46a06 service nova] [instance: e5a7bc12-2741-4ccc-98b2-98be4451aae3] Received event network-vif-deleted-8b16b74b-85f1-4fd3-b217-059cf6305f21 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:27 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:33 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:50:33 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=24.734230041503906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 15d10a18-4260-481d-bdd8-ab3778293278 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:50:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:50:34 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:50:34 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:50:34 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:50:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:50:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:50:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:50:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-changed-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Refreshing instance network info cache due to event network-changed-ebc4bfed-137f-440f-8d98-792d50d2b020. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] Acquiring lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] Acquired lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG nova.network.neutron [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Refreshing network info cache for port ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG nova.network.neutron [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updated VIF entry in instance network info cache for port ebc4bfed-137f-440f-8d98-792d50d2b020. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG nova.network.neutron [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating instance_info_cache with network_info: [{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-509b63f8-b02d-4bfc-a5ac-8473e4f89387 req-140b17f0-d4cf-4352-97f0-8cd5b974bfc4 service nova] Releasing lock "refresh_cache-7487ebe0-531a-47c4-9728-3e67d9af1909" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:50:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:45 user nova-compute[87365]: INFO nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Rebuilding instance
Nov 08 13:50:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:46 user nova-compute[87365]: WARNING nova.compute.manager [req-be6b95bd-d428-4f63-b2cf-518aa1e0e6ad req-a1dfa75c-d095-4391-a30b-18065b03a6c5 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state active and task_state rebuilding.
Nov 08 13:50:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance destroyed successfully.
Nov 08 13:50:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance destroyed successfully.
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-18149678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc4bfed-13, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd89f060-a4a2-4635-a384-07023e52c628) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:46 user nova-compute[87365]: INFO os_vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13')
Nov 08 13:50:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:50:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4511a7-97ba-4e19-9dbc-fea9cb4f5db1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:50:46 user nova-compute[87365]: No targets found.
Nov 08 13:50:46 user nova-compute[87365]: iSNS:
Nov 08 13:50:46 user nova-compute[87365]: No targets found.
Nov 08 13:50:46 user nova-compute[87365]: STATIC:
Nov 08 13:50:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:50:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:50:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:46 user nova-compute[87365]: FIRMWARE:
Nov 08 13:50:46 user nova-compute[87365]: No targets found.
Nov 08 13:50:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:50:46 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:50:46 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e676055d-05e8-4bea-9eda-a86a6e3682db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a2537-d85a-4bca-8e47-da7d0f124671]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:46 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:46 user nova-compute[87365]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:50:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15f14b-d357-49b2-8be5-b57e91d4f9af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c053793e-0de7-40db-bd4e-514be733a137]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa367b5d-4d74-41a0-98f5-0f3ca453985f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:50:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c237aa0-fc82-46cc-86c4-82bd0f7ba03d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7614cbf-1954-413a-b8f9-1e34a47bebf7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912307e-3941-4f54-a63f-4748f2f17cd4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]
Nov 08 13:50:47 user nova-compute[87365]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.
Nov 08 13:50:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159680b-c44d-4f7f-b9ef-de9f743193fd]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== disconnect_volume: return (337ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:50:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deleting instance files /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909_del
Nov 08 13:50:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deletion of /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909_del complete
Nov 08 13:50:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 could not be found.
Nov 08 13:50:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:50:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c64d389-eec3-41a5-8d4f-5c05f2b965fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:50:47 user nova-compute[87365]: No targets found.
Nov 08 13:50:47 user nova-compute[87365]: iSNS:
Nov 08 13:50:47 user nova-compute[87365]: No targets found.
Nov 08 13:50:47 user nova-compute[87365]: STATIC:
Nov 08 13:50:47 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:50:47 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:50:47 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:50:47 user nova-compute[87365]: FIRMWARE:
Nov 08 13:50:47 user nova-compute[87365]: No targets found.
Nov 08 13:50:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:50:47 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:50:47 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8449ac-a47a-4f28-93c3-b2bf185437fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a770c5d-41d8-415e-9940-c3bfd9af3c85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:50:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf859d510>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== disconnect_volume: return (69ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:50:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:50:48 user nova-compute[87365]: WARNING nova.compute.manager [req-144ce8ac-a4af-4629-8714-b9194d3eef8a req-bd8d171d-452d-4eca-ab00-a32bc432a9ae service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state active and task_state rebuilding.
Nov 08 13:50:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Preparing to wait for external event volume-reimaged-73d2b27e-1b0c-4c12-a936-634d295ec3c6 {{(pid=87365) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:50:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:50:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:50:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:00 user nova-compute[87365]: INFO nova.compute.manager [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Terminating instance
Nov 08 13:51:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-unplugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] No waiting events found dispatching network-vif-unplugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a3692d6-511b-46d8-92b0-378e55a73e1c req-e24b94e1-bd00-42db-885c-1034384667f3 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-unplugged-8fef3506-2f29-4a7c-8092-d327f43f627e for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Instance destroyed successfully.
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.objects.instance [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lazy-loading 'resources' on Instance uuid 15d10a18-4260-481d-bdd8-ab3778293278 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-55132472',display_name='tempest-VolumesAdminNegativeTest-server-55132472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-55132472',id=7,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVm8OKlPRcQa5EUpD0IVDjn/UsXkqFle83fH5f0dYFfGy4N9x6mgS67b1qv8o7I4OiRGJPhZyCoEakVE0bROXnrRUF3Bc0QVeltv5bnQja92phhiobbZxSje0PM6jTdRw==',key_name='tempest-keypair-225236727',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:44:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fa801fe72a5410fade93d2db86d1f9d',ramdisk_id='',reservation_id='r-ccia4c5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1087803050',owner_user_name='tempest-VolumesAdminNegativeTest-1087803050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:44:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002ccda1ce646f4a0a771982c76d3f1',uuid=15d10a18-4260-481d-bdd8-ab3778293278,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converting VIF {"id": "8fef3506-2f29-4a7c-8092-d327f43f627e", "address": "fa:16:3e:d9:79:98", "network": {"id": "fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1314634225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fa801fe72a5410fade93d2db86d1f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fef3506-2f", "ovs_interfaceid": "8fef3506-2f29-4a7c-8092-d327f43f627e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG os_vif [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fef3506-2f, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efa43d1a-5386-41cb-85ac-e0f98035c2ec) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:01 user nova-compute[87365]: INFO os_vif [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:79:98,bridge_name='br-int',has_traffic_filtering=True,id=8fef3506-2f29-4a7c-8092-d327f43f627e,network=Network(fc11c4fc-00cd-4f4e-b9d1-7e4c4d7a89ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fef3506-2f')
Nov 08 13:51:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Deleting instance files /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278_del
Nov 08 13:51:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Deletion of /opt/stack/data/nova/instances/15d10a18-4260-481d-bdd8-ab3778293278_del complete
Nov 08 13:51:01 user nova-compute[87365]: INFO nova.compute.manager [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 13:51:01 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:51:01 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:02 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Took 1.04 seconds to deallocate network for instance.
Nov 08 13:51:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] Acquiring lock "15d10a18-4260-481d-bdd8-ab3778293278-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] Lock "15d10a18-4260-481d-bdd8-ab3778293278-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] No waiting events found dispatching network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:02 user nova-compute[87365]: WARNING nova.compute.manager [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received unexpected event network-vif-plugged-8fef3506-2f29-4a7c-8092-d327f43f627e for instance with vm_state deleted and task_state None.
Nov 08 13:51:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-0efbad6b-5d6f-4abe-942f-5f1fdbad8c91 req-e935be4f-e223-43de-8dd3-4a2f65ad3757 service nova] [instance: 15d10a18-4260-481d-bdd8-ab3778293278] Received event network-vif-deleted-8fef3506-2f29-4a7c-8092-d327f43f627e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:02 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:51:03 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:51:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.683s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:03 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Deleted allocations for instance 15d10a18-4260-481d-bdd8-ab3778293278
Nov 08 13:51:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-045ca3f3-46ff-40bd-8112-80b9e5fc02ea tempest-VolumesAdminNegativeTest-1087803050 tempest-VolumesAdminNegativeTest-1087803050-project-member] Lock "15d10a18-4260-481d-bdd8-ab3778293278" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.026s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:03 user nova-compute[87365]: INFO nova.compute.manager [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Unrescuing
Nov 08 13:51:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:51:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:51:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:51:04 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:51:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'flavor' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:05 user nova-compute[87365]: WARNING nova.compute.manager [req-cf404d86-b3d1-4816-b0c1-9ec6729f603e req-5f290ad3-de95-4176-852b-ac5b66ca7f3a service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:51:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance destroyed successfully.
Nov 08 13:51:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1c78bdf1-c371-43f1-8be1-3f3836652220 req-10ba979b-b7f4-416f-99d5-5d808a59e494 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:51:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:09 user nova-compute[87365]: WARNING nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:51:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:09 user nova-compute[87365]: WARNING nova.compute.manager [req-dab6343e-d1b6-4b70-a4e9-6e14df37a039 req-28d63b8b-d3c9-452b-9856-fb9a83329f50 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state rescued and task_state unrescuing.
Nov 08 13:51:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1d28868c-0170-4e06-8d6d-99361a598548 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:51:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:51:24 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:51:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-08c1eae3-7321-44b0-ac30-9d5d9822623f req-9653a84f-e097-47d4-964a-737f4d0e88c2 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event volume-reimaged-73d2b27e-1b0c-4c12-a936-634d295ec3c6 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-08c1eae3-7321-44b0-ac30-9d5d9822623f req-9653a84f-e097-47d4-964a-737f4d0e88c2 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-08c1eae3-7321-44b0-ac30-9d5d9822623f req-9653a84f-e097-47d4-964a-737f4d0e88c2 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-08c1eae3-7321-44b0-ac30-9d5d9822623f req-9653a84f-e097-47d4-964a-737f4d0e88c2 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-08c1eae3-7321-44b0-ac30-9d5d9822623f req-9653a84f-e097-47d4-964a-737f4d0e88c2 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Processing event volume-reimaged-73d2b27e-1b0c-4c12-a936-634d295ec3c6 {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance event wait completed in 39 seconds for volume-reimaged {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:51:28 user nova-compute[87365]: INFO nova.virt.block_device [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Booting with volume 73d2b27e-1b0c-4c12-a936-634d295ec3c6 at /dev/vda
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.utils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b46bc19-5c46-495d-a027-dc1f65404a79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1445c5aa-360b-41f8-b76c-5e7566035cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c6e6e-5f42-48ef-9706-8a8a9b608455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb38800-25ee-4f60-9b27-907b5d05890e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:51:28 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c173912-db80-4eee-937d-82abdec319cd]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG os_brick.utils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating existing volume attachment record: 4ca3e772-a881-40da-8782-23b593b2eea6 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:51:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:30 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:30 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:51:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-changed-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing instance network info cache due to event network-changed-da26a3d5-6b7b-496a-bbb9-a870e543d816. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing network info cache for port da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'flavor' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.network.neutron [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updated VIF entry in instance network info cache for port da26a3d5-6b7b-496a-bbb9-a870e543d816. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.network.neutron [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'pci_requests' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bc4b7d12-ac6d-4217-8dc0-387475ee0104 req-1b147140-a12c-40e2-8362-d3f25a925a1e service nova] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.objects.base [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Object Instance<6b61eb52-9ddd-4948-a037-4db6d2d779e6> lazy-loaded attributes: flavor,pci_requests {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:34 user nova-compute[87365]: DEBUG nova.policy [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36139bf35e1f4f68bca23eda26b58ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa29529fcf8483ca51cc68454c9071d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:51:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7912MB free_disk=24.74969482421875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Successfully created port: faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:51:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Successfully updated port: faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-changed-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing instance network info cache due to event network-changed-faf7d23b-ddf9-4f6b-a876-627c5c2b1619. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:51:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Refreshing network info cache for port faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG os_vif [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b6f73af-cf2d-5dd4-9505-ecb68c6e2df1', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaf7d23b-dd, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfaf7d23b-dd, col_values=(('qos', UUID('76397e97-2b3c-4f1c-b4f5-2b99a4b09c7e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfaf7d23b-dd, col_values=(('external_ids', {'iface-id': 'faf7d23b-ddf9-4f6b-a876-627c5c2b1619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:65:6f', 'vm-uuid': '6b61eb52-9ddd-4948-a037-4db6d2d779e6'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: INFO os_vif [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd')
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] attach device xml: <interface type="ethernet">
Nov 08 13:51:37 user nova-compute[87365]:   <mac address="fa:16:3e:9c:65:6f"/>
Nov 08 13:51:37 user nova-compute[87365]:   <model type="virtio"/>
Nov 08 13:51:37 user nova-compute[87365]:   <mtu size="1442"/>
Nov 08 13:51:37 user nova-compute[87365]:   <target dev="tapfaf7d23b-dd"/>
Nov 08 13:51:37 user nova-compute[87365]: </interface>
Nov 08 13:51:37 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name hda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No VIF found with MAC fa:16:3e:3b:6a:39, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:51:37 user nova-compute[87365]:   <nova:package version="0.0.0"/>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:name>tempest-device-tagging-server-401134231</nova:name>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:creationTime>2023-11-08 13:51:37</nova:creationTime>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:flavor name="m1.tiny">
Nov 08 13:51:37 user nova-compute[87365]:     <nova:memory>512</nova:memory>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:disk>1</nova:disk>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:swap>0</nova:swap>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:vcpus>1</nova:vcpus>
Nov 08 13:51:37 user nova-compute[87365]:   </nova:flavor>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:owner>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:user uuid="36139bf35e1f4f68bca23eda26b58ed8">tempest-TaggedAttachmentsTest-1724451289-project-member</nova:user>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:project uuid="daa29529fcf8483ca51cc68454c9071d">tempest-TaggedAttachmentsTest-1724451289</nova:project>
Nov 08 13:51:37 user nova-compute[87365]:   </nova:owner>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:51:37 user nova-compute[87365]:   <nova:ports>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:port uuid="da26a3d5-6b7b-496a-bbb9-a870e543d816">
Nov 08 13:51:37 user nova-compute[87365]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:51:37 user nova-compute[87365]:     </nova:port>
Nov 08 13:51:37 user nova-compute[87365]:     <nova:port uuid="faf7d23b-ddf9-4f6b-a876-627c5c2b1619">
Nov 08 13:51:37 user nova-compute[87365]:       <nova:ip type="fixed" address="10.10.10.151" ipVersion="4"/>
Nov 08 13:51:37 user nova-compute[87365]:     </nova:port>
Nov 08 13:51:37 user nova-compute[87365]:   </nova:ports>
Nov 08 13:51:37 user nova-compute[87365]: </nova:instance>
Nov 08 13:51:37 user nova-compute[87365]:  {{(pid=87365) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 13:51:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a5e457a8-aee7-4693-b88e-afa6d6c6ba3d tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.344s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updated VIF entry in instance network info cache for port faf7d23b-ddf9-4f6b-a876-627c5c2b1619. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f369dda-ca74-4207-a51a-0091238b3e86 req-bc41acbf-36fa-4b67-9fe1-373710828cfc service nova] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:38 user nova-compute[87365]: WARNING nova.compute.manager [req-bf2e2612-6fe3-4327-8cc5-454db5651c2f req-d164243d-451b-4954-baac-5ce4ccdc5c44 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 for instance with vm_state active and task_state None.
Nov 08 13:51:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'flavor' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:38 user nova-compute[87365]: INFO nova.compute.manager [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Attaching volume f03b9e2f-edab-4f67-bf12-9cb001ec7267 to /dev/vdb
Nov 08 13:51:38 user nova-compute[87365]: DEBUG os_brick.utils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddef927c-34af-4e56-be13-a508e64d1fcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd15c1-4a64-4ac4-8803-b7069903c971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[df95bb36-8175-4003-ab8f-1a9e2797d336]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e0926-6f9b-4397-933a-24466a9c08ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:51:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:51:39 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:51:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d0dd5-236f-4da0-a6d2-26f2c9e5fe01]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG os_brick.utils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:51:39 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating existing volume attachment record: a463be00-bfee-4ad9-922c-897032533c09 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:51:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:51:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:51:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:51:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:51:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:51:40 user nova-compute[87365]: WARNING nova.compute.manager [req-36f88542-dc6c-4c3c-9420-f416141275d9 req-86804a99-26a0-40ac-89ae-07292fdddddd service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 for instance with vm_state active and task_state None.
Nov 08 13:51:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:51:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:52:13 user nova-compute[87365]: INFO nova.compute.claims [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Claim successful on node user
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:52:14 user nova-compute[87365]: INFO nova.compute.claims [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Claim successful on node user
Nov 08 13:52:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.policy [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '056f4860196044679b260c22a8c83f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4f3ebf487840099cd65d5c708fe710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Creating image(s)
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.232s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.239s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk 1073741824" returned: 0 in 0.085s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:52:15 user nova-compute[87365]: INFO nova.compute.claims [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Claim successful on node user
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Successfully created port: 1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.246s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.policy [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcd7df777ca44c238e448e808092dc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556c0d0130234d60b855c506902fa06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Creating image(s)
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "/opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "/opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "/opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Cannot resize image /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Ensure instance console log exists: /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.242s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.247s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk 1073741824" returned: 0 in 0.088s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.policy [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ad4efa600524c27a048bd565bf1852c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9d5da6823541c282006a7871e50ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Cannot resize image /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Ensure instance console log exists: /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Successfully created port: 89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Creating image(s)
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Successfully updated port: 1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-changed-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Refreshing instance network info cache due to event network-changed-1becc56c-05fc-4353-9bb9-7ed7ad36cbda. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk 1073741824" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance network_info: |[{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Refreshing network info cache for port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start _get_guest_xml network_info=[{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'pci_devices' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:17 user nova-compute[87365]:   <uuid>de510f72-fe85-4b4f-8938-ca8976aaff02</uuid>
Nov 08 13:52:17 user nova-compute[87365]:   <name>instance-00000016</name>
Nov 08 13:52:17 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:17 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:17 user nova-compute[87365]:   <metadata>
Nov 08 13:52:17 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:17 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:name>tempest-ServerActionsTestOtherB-server-1002097682</nova:name>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:17</nova:creationTime>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:17 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:17 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:user uuid="056f4860196044679b260c22a8c83f7f">tempest-ServerActionsTestOtherB-1469249614-project-member</nova:user>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:project uuid="cf4f3ebf487840099cd65d5c708fe710">tempest-ServerActionsTestOtherB-1469249614</nova:project>
Nov 08 13:52:17 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:17 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:17 user nova-compute[87365]:         <nova:port uuid="1becc56c-05fc-4353-9bb9-7ed7ad36cbda">
Nov 08 13:52:17 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 13:52:17 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:17 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:17 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:17 user nova-compute[87365]:   </metadata>
Nov 08 13:52:17 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:17 user nova-compute[87365]:     <system>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="serial">de510f72-fe85-4b4f-8938-ca8976aaff02</entry>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="uuid">de510f72-fe85-4b4f-8938-ca8976aaff02</entry>
Nov 08 13:52:17 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:17 user nova-compute[87365]:     </system>
Nov 08 13:52:17 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:17 user nova-compute[87365]:   <os>
Nov 08 13:52:17 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:17 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:17 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:17 user nova-compute[87365]:   </os>
Nov 08 13:52:17 user nova-compute[87365]:   <features>
Nov 08 13:52:17 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:17 user nova-compute[87365]:     <apic/>
Nov 08 13:52:17 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:17 user nova-compute[87365]:   </features>
Nov 08 13:52:17 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:17 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:17 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:17 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:17 user nova-compute[87365]:   </clock>
Nov 08 13:52:17 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:17 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:17 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:17 user nova-compute[87365]:   </cpu>
Nov 08 13:52:17 user nova-compute[87365]:   <devices>
Nov 08 13:52:17 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:52:17 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:52:17 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk"/>
Nov 08 13:52:17 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:17 user nova-compute[87365]:     </disk>
Nov 08 13:52:17 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:17 user nova-compute[87365]:       <mac address="fa:16:3e:2f:76:b0"/>
Nov 08 13:52:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:17 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:17 user nova-compute[87365]:       <target dev="tap1becc56c-05"/>
Nov 08 13:52:17 user nova-compute[87365]:     </interface>
Nov 08 13:52:17 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:17 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/console.log" append="off"/>
Nov 08 13:52:17 user nova-compute[87365]:     </serial>
Nov 08 13:52:17 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:17 user nova-compute[87365]:     <video>
Nov 08 13:52:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:17 user nova-compute[87365]:     </video>
Nov 08 13:52:17 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:17 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:17 user nova-compute[87365]:     </rng>
Nov 08 13:52:17 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:17 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:17 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:17 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:17 user nova-compute[87365]:   </devices>
Nov 08 13:52:17 user nova-compute[87365]: </domain>
Nov 08 13:52:17 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG os_vif [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '167361b3-fd46-51cc-925d-59496832625e', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1becc56c-05, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1becc56c-05, col_values=(('qos', UUID('61f89423-abd2-4280-bf79-efc8532dbc9e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1becc56c-05, col_values=(('external_ids', {'iface-id': '1becc56c-05fc-4353-9bb9-7ed7ad36cbda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:76:b0', 'vm-uuid': 'de510f72-fe85-4b4f-8938-ca8976aaff02'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:17 user nova-compute[87365]: INFO os_vif [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05')
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No VIF found with MAC fa:16:3e:2f:76:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.390s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Cannot resize image /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Ensure instance console log exists: /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updated VIF entry in instance network info cache for port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5729bcb8-192e-48d4-a79c-80deee0d0aef req-47a39a79-e120-4598-9584-b78cad3e3619 service nova] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Successfully created port: eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Successfully updated port: 89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquired lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-changed-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Refreshing instance network info cache due to event network-changed-89b17369-87fc-4de5-8ea4-84c6b2420a3c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] Acquiring lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.neutron [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Updating instance_info_cache with network_info: [{"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Releasing lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Instance network_info: |[{"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] Acquired lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.neutron [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Refreshing network info cache for port 89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Start _get_guest_xml network_info=[{"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:19 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:19 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-331879792',display_name='tempest-VolumesNegativeTest-instance-331879792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-331879792',id=23,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556c0d0130234d60b855c506902fa06a',ramdisk_id='',reservation_id='r-wn4vdqpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-877281963',owner_user_name='tempest-VolumesNegativeTest-877281963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:16Z,user_data=None,user_id='dcd7df777ca44c238e448e808092dc16',uuid=f00c96a7-38c9-4dae-be45-7b14b3db8ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converting VIF {"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.objects.instance [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lazy-loading 'pci_devices' on Instance uuid f00c96a7-38c9-4dae-be45-7b14b3db8ae9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:19 user nova-compute[87365]:   <uuid>f00c96a7-38c9-4dae-be45-7b14b3db8ae9</uuid>
Nov 08 13:52:19 user nova-compute[87365]:   <name>instance-00000017</name>
Nov 08 13:52:19 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:19 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:19 user nova-compute[87365]:   <metadata>
Nov 08 13:52:19 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:19 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:name>tempest-VolumesNegativeTest-instance-331879792</nova:name>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:19</nova:creationTime>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:19 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:19 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:user uuid="dcd7df777ca44c238e448e808092dc16">tempest-VolumesNegativeTest-877281963-project-member</nova:user>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:project uuid="556c0d0130234d60b855c506902fa06a">tempest-VolumesNegativeTest-877281963</nova:project>
Nov 08 13:52:19 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:19 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:19 user nova-compute[87365]:         <nova:port uuid="89b17369-87fc-4de5-8ea4-84c6b2420a3c">
Nov 08 13:52:19 user nova-compute[87365]:           <nova:ip type="fixed" address="192.168.233.135" ipVersion="4"/>
Nov 08 13:52:19 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:19 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:19 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:19 user nova-compute[87365]:   </metadata>
Nov 08 13:52:19 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:19 user nova-compute[87365]:     <system>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="serial">f00c96a7-38c9-4dae-be45-7b14b3db8ae9</entry>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="uuid">f00c96a7-38c9-4dae-be45-7b14b3db8ae9</entry>
Nov 08 13:52:19 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:19 user nova-compute[87365]:     </system>
Nov 08 13:52:19 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:19 user nova-compute[87365]:   <os>
Nov 08 13:52:19 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:19 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:19 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:19 user nova-compute[87365]:   </os>
Nov 08 13:52:19 user nova-compute[87365]:   <features>
Nov 08 13:52:19 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:19 user nova-compute[87365]:     <apic/>
Nov 08 13:52:19 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:19 user nova-compute[87365]:   </features>
Nov 08 13:52:19 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:19 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:19 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:19 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:19 user nova-compute[87365]:   </clock>
Nov 08 13:52:19 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:19 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:19 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:19 user nova-compute[87365]:   </cpu>
Nov 08 13:52:19 user nova-compute[87365]:   <devices>
Nov 08 13:52:19 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:52:19 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:52:19 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk"/>
Nov 08 13:52:19 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:19 user nova-compute[87365]:     </disk>
Nov 08 13:52:19 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:19 user nova-compute[87365]:       <mac address="fa:16:3e:46:32:d0"/>
Nov 08 13:52:19 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:19 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:19 user nova-compute[87365]:       <target dev="tap89b17369-87"/>
Nov 08 13:52:19 user nova-compute[87365]:     </interface>
Nov 08 13:52:19 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:19 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/console.log" append="off"/>
Nov 08 13:52:19 user nova-compute[87365]:     </serial>
Nov 08 13:52:19 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:19 user nova-compute[87365]:     <video>
Nov 08 13:52:19 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:19 user nova-compute[87365]:     </video>
Nov 08 13:52:19 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:19 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:19 user nova-compute[87365]:     </rng>
Nov 08 13:52:19 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:19 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:19 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:19 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:19 user nova-compute[87365]:   </devices>
Nov 08 13:52:19 user nova-compute[87365]: </domain>
Nov 08 13:52:19 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-331879792',display_name='tempest-VolumesNegativeTest-instance-331879792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-331879792',id=23,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='556c0d0130234d60b855c506902fa06a',ramdisk_id='',reservation_id='r-wn4vdqpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-877281963',owner_user_name='tempest-VolumesNegativeTest-877281963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:16Z,user_data=None,user_id='dcd7df777ca44c238e448e808092dc16',uuid=f00c96a7-38c9-4dae-be45-7b14b3db8ae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converting VIF {"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG os_vif [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e6c97e7-e555-5231-b0f0-ab6e875cd208', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89b17369-87, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89b17369-87, col_values=(('qos', UUID('2a0a8323-82d1-455e-96ba-842a27e040f2')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89b17369-87, col_values=(('external_ids', {'iface-id': '89b17369-87fc-4de5-8ea4-84c6b2420a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:32:d0', 'vm-uuid': 'f00c96a7-38c9-4dae-be45-7b14b3db8ae9'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:19 user nova-compute[87365]: INFO os_vif [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87')
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:19 user nova-compute[87365]: WARNING nova.compute.manager [req-9c850015-4e53-440e-b83c-7fcea50386c2 req-0c045be8-1c9a-4d37-a125-c2cb92d0bd31 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state building and task_state spawning.
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] No VIF found with MAC fa:16:3e:46:32:d0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Successfully updated port: eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Updated VIF entry in instance network info cache for port 89b17369-87fc-4de5-8ea4-84c6b2420a3c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Updating instance_info_cache with network_info: [{"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8987425e-f498-426f-b592-4ed32e161aaf req-027613d3-7855-45bb-a777-48131953f39c service nova] Releasing lock "refresh_cache-f00c96a7-38c9-4dae-be45-7b14b3db8ae9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance network_info: |[{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start _get_guest_xml network_info=[{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:20 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:20 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7GSrNwtZi+QUTBs0XGg3Hyc/mamJ2jeRuv3YWc4nB5YJrJkN57xMdy0xafTS/F7WTUWxI6YxvPGxssn9C8j/b2TaZDYK5mHDa4+iy9kKSbyDkxkQjaCfp4bW+eQJVvwg==',key_name='tempest-keypair-2111570019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing instance network info cache due to event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:20 user nova-compute[87365]:   <uuid>5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</uuid>
Nov 08 13:52:20 user nova-compute[87365]:   <name>instance-00000018</name>
Nov 08 13:52:20 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:20 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:20 user nova-compute[87365]:   <metadata>
Nov 08 13:52:20 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:20 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1096987352</nova:name>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:20</nova:creationTime>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:20 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:20 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:user uuid="3ad4efa600524c27a048bd565bf1852c">tempest-AttachVolumeShelveTestJSON-1136658600-project-member</nova:user>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:project uuid="8f9d5da6823541c282006a7871e50ca8">tempest-AttachVolumeShelveTestJSON-1136658600</nova:project>
Nov 08 13:52:20 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:20 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:20 user nova-compute[87365]:         <nova:port uuid="eb853533-e9d7-4cec-a4fc-6185232a7b57">
Nov 08 13:52:20 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:52:20 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:20 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:20 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:20 user nova-compute[87365]:   </metadata>
Nov 08 13:52:20 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:20 user nova-compute[87365]:     <system>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="serial">5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</entry>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="uuid">5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</entry>
Nov 08 13:52:20 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:20 user nova-compute[87365]:     </system>
Nov 08 13:52:20 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:20 user nova-compute[87365]:   <os>
Nov 08 13:52:20 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:20 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:20 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:20 user nova-compute[87365]:   </os>
Nov 08 13:52:20 user nova-compute[87365]:   <features>
Nov 08 13:52:20 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:20 user nova-compute[87365]:     <apic/>
Nov 08 13:52:20 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:20 user nova-compute[87365]:   </features>
Nov 08 13:52:20 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:20 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:20 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:20 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:20 user nova-compute[87365]:   </clock>
Nov 08 13:52:20 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:20 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:20 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:20 user nova-compute[87365]:   </cpu>
Nov 08 13:52:20 user nova-compute[87365]:   <devices>
Nov 08 13:52:20 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:52:20 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:52:20 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk"/>
Nov 08 13:52:20 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:20 user nova-compute[87365]:     </disk>
Nov 08 13:52:20 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:20 user nova-compute[87365]:       <mac address="fa:16:3e:cd:bb:2c"/>
Nov 08 13:52:20 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:20 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:20 user nova-compute[87365]:       <target dev="tapeb853533-e9"/>
Nov 08 13:52:20 user nova-compute[87365]:     </interface>
Nov 08 13:52:20 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:20 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/console.log" append="off"/>
Nov 08 13:52:20 user nova-compute[87365]:     </serial>
Nov 08 13:52:20 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:20 user nova-compute[87365]:     <video>
Nov 08 13:52:20 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:20 user nova-compute[87365]:     </video>
Nov 08 13:52:20 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:20 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:20 user nova-compute[87365]:     </rng>
Nov 08 13:52:20 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:20 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:20 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:20 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:20 user nova-compute[87365]:   </devices>
Nov 08 13:52:20 user nova-compute[87365]: </domain>
Nov 08 13:52:20 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7GSrNwtZi+QUTBs0XGg3Hyc/mamJ2jeRuv3YWc4nB5YJrJkN57xMdy0xafTS/F7WTUWxI6YxvPGxssn9C8j/b2TaZDYK5mHDa4+iy9kKSbyDkxkQjaCfp4bW+eQJVvwg==',key_name='tempest-keypair-2111570019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG os_vif [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5592bbe5-2d19-584d-a858-50e374a2b0ed', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb853533-e9, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb853533-e9, col_values=(('qos', UUID('289dded0-6dab-44ff-ab38-612603fe76ca')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb853533-e9, col_values=(('external_ids', {'iface-id': 'eb853533-e9d7-4cec-a4fc-6185232a7b57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:bb:2c', 'vm-uuid': '5d6ef0e9-a59a-4456-9da2-de8ee5a874f9'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:20 user nova-compute[87365]: INFO os_vif [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9')
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No VIF found with MAC fa:16:3e:cd:bb:2c, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwbFWEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:52:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:52:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:52:21 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4191b7bb-fda4-48c4-9a1b-f62e72ba763b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:52:21 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updated VIF entry in instance network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91457b8-6004-4ca1-86fa-72f581972cf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267] added
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-27db47d8-0af4-46d1-9814-5ac348421535 req-9face93f-ba75-4abe-8dcd-74542c17dc0c service nova] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e0e0d-2e76-4519-a2c9-03236359d065]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49a2b82-84cf-42cd-8275-b4221ffda287]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycwbFWEJ {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycwbFWEJ" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64b346-e1c6-451e-b1b0-8e050b901e49]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycwbFWEJ'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[de420972-0dce-4e86-929d-27e388067551]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Creating image(s)
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Ensure instance console log exists: /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start _get_guest_xml network_info=[{"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7487ebe0-531a-47c4-9728-3e67d9af1909', 'attached_at': '', 'detached_at': '', 'volume_id': '73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'serial': '73d2b27e-1b0c-4c12-a936-634d295ec3c6'}, 'attachment_id': '4ca3e772-a881-40da-8782-23b593b2eea6', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f93d0-50ec-45b4-94d8-8dd826fd9645]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:52:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 13:52:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7487ebe0-531a-47c4-9728-3e67d9af1909 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c76e00-26f4-4c7e-bd0a-ad8075077210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260]
Nov 08 13:52:21 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260] successful.
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:52:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc81d29-286f-4b29-bd24-07f1dc0d22ee]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d194971c-8cbb-4355-9706-936b2ecce212]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:21 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:21 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d175b937-5b85-4d76-a4bb-a10148eb3dce]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:21 user nova-compute[87365]: WARNING nova.compute.manager [req-d5d0b796-bbde-455c-b497-2ceeabded59e req-329f1ad7-f975-4eb1-9034-bc382625862e service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state building and task_state spawning.
Nov 08 13:52:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:52:22 user nova-compute[87365]: INFO nova.compute.claims [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Claim successful on node user
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwbFWEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23866346562373933', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866346562373933', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.102s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:52:22 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:52:22 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'flavor' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7a17f6-b733-44df-9d43-869b3f30700b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:52:22 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:52:22 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:52:22 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:52:22 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:52:22 user nova-compute[87365]:   <serial>f03b9e2f-edab-4f67-bf12-9cb001ec7267</serial>
Nov 08 13:52:22 user nova-compute[87365]: </disk>
Nov 08 13:52:22 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c20ef95-5d1c-45b2-bd2f-87181d522fd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6] added
Nov 08 13:52:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e536b-3660-472f-bf39-09b6b58ba890]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff7561a-2349-49a7-956c-d7dd9c3c20d3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvFjKabU {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvFjKabU" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d254f26b-3d51-42fb-b840-41ae1037853d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvFjKabU'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2e765-6a51-475b-b2f3-6ce0646769f4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd67d2-f3a5-4ef1-bd67-32866dc2fa6a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:22 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:22 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87de89c-c44d-44cd-bb86-e64e16043660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]
Nov 08 13:52:22 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.
Nov 08 13:52:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac2fb3-252e-446a-97c4-a4992b38f980]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:52:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance spawned successfully.
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f967a3d-d672-4b7e-80b5-6a6c4a3e3da2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:23 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:23 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:52:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:23 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:23 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:52:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad889afc-ac0a-4b77-876f-cc5e9e96691c]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:52:23 user nova-compute[87365]: INFO nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Took 8.44 seconds to spawn the instance on the hypervisor.
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:52:23 user nova-compute[87365]: INFO nova.compute.manager [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Took 9.55 seconds to build instance.
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No BDM found with device name hda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] No VIF found with MAC fa:16:3e:3b:6a:39, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-55290c9b-0384-44ee-9cc2-dd2974767c11 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.692s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:52:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.policy [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74300a84ce074dd38166c961d57071cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddd66e9d6104a2c8e71279551cb6b4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-253bafd2-7c6f-44ae-8508-1fc10435cd00 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.851s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Creating image(s)
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "/opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "/opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] No waiting events found dispatching network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:23 user nova-compute[87365]: WARNING nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received unexpected event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c for instance with vm_state building and task_state spawning.
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] No waiting events found dispatching network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:23 user nova-compute[87365]: WARNING nova.compute.manager [req-84ed275a-534d-48c2-8060-67d8e458753c req-768d37f9-15ee-4ef5-81df-0e0b26f47349 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received unexpected event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c for instance with vm_state building and task_state spawning.
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== connect_volume: return (2505ms) {'type': 'block', 'scsi_wwn': '23030353034306530', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353034306530', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-18149678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:24 user nova-compute[87365]:   <uuid>7487ebe0-531a-47c4-9728-3e67d9af1909</uuid>
Nov 08 13:52:24 user nova-compute[87365]:   <name>instance-00000014</name>
Nov 08 13:52:24 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:24 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:24 user nova-compute[87365]:   <metadata>
Nov 08 13:52:24 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:24 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:24 user nova-compute[87365]:       <nova:name>tempest-ServerActionsV293TestJSON-server-18149678</nova:name>
Nov 08 13:52:24 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:21</nova:creationTime>
Nov 08 13:52:24 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:24 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:24 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:24 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:user uuid="23c385effdb74adbb4b090ada3770c9c">tempest-ServerActionsV293TestJSON-612073398-project-member</nova:user>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:project uuid="aa81d579f8d14baa86b0279e7cf22974">tempest-ServerActionsV293TestJSON-612073398</nova:project>
Nov 08 13:52:24 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:24 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:24 user nova-compute[87365]:         <nova:port uuid="ebc4bfed-137f-440f-8d98-792d50d2b020">
Nov 08 13:52:24 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:52:24 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:24 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:24 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:24 user nova-compute[87365]:   </metadata>
Nov 08 13:52:24 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:24 user nova-compute[87365]:     <system>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="serial">7487ebe0-531a-47c4-9728-3e67d9af1909</entry>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="uuid">7487ebe0-531a-47c4-9728-3e67d9af1909</entry>
Nov 08 13:52:24 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:24 user nova-compute[87365]:     </system>
Nov 08 13:52:24 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:24 user nova-compute[87365]:   <os>
Nov 08 13:52:24 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:24 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:24 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:24 user nova-compute[87365]:   </os>
Nov 08 13:52:24 user nova-compute[87365]:   <features>
Nov 08 13:52:24 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:24 user nova-compute[87365]:     <apic/>
Nov 08 13:52:24 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:24 user nova-compute[87365]:   </features>
Nov 08 13:52:24 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:24 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:24 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:24 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:24 user nova-compute[87365]:   </clock>
Nov 08 13:52:24 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:24 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:24 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:24 user nova-compute[87365]:   </cpu>
Nov 08 13:52:24 user nova-compute[87365]:   <devices>
Nov 08 13:52:24 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:52:24 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:52:24 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 13:52:24 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:24 user nova-compute[87365]:       <serial>73d2b27e-1b0c-4c12-a936-634d295ec3c6</serial>
Nov 08 13:52:24 user nova-compute[87365]:     </disk>
Nov 08 13:52:24 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:24 user nova-compute[87365]:       <mac address="fa:16:3e:91:49:62"/>
Nov 08 13:52:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:24 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:24 user nova-compute[87365]:       <target dev="tapebc4bfed-13"/>
Nov 08 13:52:24 user nova-compute[87365]:     </interface>
Nov 08 13:52:24 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:24 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909/console.log" append="off"/>
Nov 08 13:52:24 user nova-compute[87365]:     </serial>
Nov 08 13:52:24 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:24 user nova-compute[87365]:     <video>
Nov 08 13:52:24 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:24 user nova-compute[87365]:     </video>
Nov 08 13:52:24 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:24 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:24 user nova-compute[87365]:     </rng>
Nov 08 13:52:24 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:24 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:24 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:24 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:24 user nova-compute[87365]:   </devices>
Nov 08 13:52:24 user nova-compute[87365]: </domain>
Nov 08 13:52:24 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-18149678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG os_vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddb75581-133d-5991-bb2d-7f87f019ec99', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.260s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:24 user nova-compute[87365]: WARNING nova.compute.manager [req-57375010-46a4-4f53-8101-482c0b52bcc0 req-e0f84d04-de31-4a3b-9b37-96ddd56992a1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state building and task_state spawning.
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk 1073741824" returned: 0 in 0.101s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc4bfed-13, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebc4bfed-13, col_values=(('qos', UUID('cdbf1190-ee69-4fbe-872a-01ea2e7454e3')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebc4bfed-13, col_values=(('external_ids', {'iface-id': 'ebc4bfed-137f-440f-8d98-792d50d2b020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:49:62', 'vm-uuid': '7487ebe0-531a-47c4-9728-3e67d9af1909'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: INFO os_vif [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13')
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.262s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] No VIF found with MAC fa:16:3e:91:49:62, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Successfully created port: 97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Cannot resize image /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Ensure instance console log exists: /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:25 user nova-compute[87365]: INFO nova.compute.manager [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Detaching volume f03b9e2f-edab-4f67-bf12-9cb001ec7267
Nov 08 13:52:25 user nova-compute[87365]: INFO nova.virt.block_device [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Attempting to driver detach volume f03b9e2f-edab-4f67-bf12-9cb001ec7267 from mountpoint /dev/vdb
Nov 08 13:52:25 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Attempting to detach device vdb from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:52:25 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:52:25 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:52:25 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:52:25 user nova-compute[87365]:   <serial>f03b9e2f-edab-4f67-bf12-9cb001ec7267</serial>
Nov 08 13:52:25 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 13:52:25 user nova-compute[87365]: </disk>
Nov 08 13:52:25 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:52:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully detached device vdb from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the persistent domain config.
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:52:25 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:52:25 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 13:52:25 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:52:25 user nova-compute[87365]:   <serial>f03b9e2f-edab-4f67-bf12-9cb001ec7267</serial>
Nov 08 13:52:25 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 13:52:25 user nova-compute[87365]: </disk>
Nov 08 13:52:25 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Successfully updated port: 97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquired lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:52:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:52:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Instance spawned successfully.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updating instance_info_cache with network_info: [{"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:26 user nova-compute[87365]: WARNING nova.compute.manager [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state building and task_state spawning.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-changed-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Refreshing instance network info cache due to event network-changed-97594d65-a575-4324-a713-6892a8a1a70b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Acquiring lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Releasing lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Instance network_info: |[{"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Acquired lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Refreshing network info cache for port 97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Start _get_guest_xml network_info=[{"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:26 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:26 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268076932',display_name='tempest-ServerRescueNegativeTestJSON-server-268076932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268076932',id=25,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnj3SAEJU5zWUYfvOMXZ5/A6s6v/2KL7OtTas/9rkpuK3LxvKunsr07YCvVByZsH1cggrYdae+wPjQPDV8Nc3BLpIMWZFI6QCLyWctSsOJ+VjEE8IZ1wK8d5ev+nWlw+g==',key_name='tempest-keypair-1910691992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-7tef06af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74300a84ce074dd38166c961d57071cd',uuid=f01a521f-e959-4924-9d84-930bede41ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'pci_devices' on Instance uuid f01a521f-e959-4924-9d84-930bede41ab1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:26 user nova-compute[87365]: INFO nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Took 10.78 seconds to spawn the instance on the hypervisor.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:26 user nova-compute[87365]:   <uuid>f01a521f-e959-4924-9d84-930bede41ab1</uuid>
Nov 08 13:52:26 user nova-compute[87365]:   <name>instance-00000019</name>
Nov 08 13:52:26 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:26 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:26 user nova-compute[87365]:   <metadata>
Nov 08 13:52:26 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:26 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-268076932</nova:name>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:26</nova:creationTime>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:26 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:26 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:user uuid="74300a84ce074dd38166c961d57071cd">tempest-ServerRescueNegativeTestJSON-954030017-project-member</nova:user>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:project uuid="4ddd66e9d6104a2c8e71279551cb6b4d">tempest-ServerRescueNegativeTestJSON-954030017</nova:project>
Nov 08 13:52:26 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:26 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:26 user nova-compute[87365]:         <nova:port uuid="97594d65-a575-4324-a713-6892a8a1a70b">
Nov 08 13:52:26 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 13:52:26 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:26 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:26 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:26 user nova-compute[87365]:   </metadata>
Nov 08 13:52:26 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:26 user nova-compute[87365]:     <system>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="serial">f01a521f-e959-4924-9d84-930bede41ab1</entry>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="uuid">f01a521f-e959-4924-9d84-930bede41ab1</entry>
Nov 08 13:52:26 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:26 user nova-compute[87365]:     </system>
Nov 08 13:52:26 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:26 user nova-compute[87365]:   <os>
Nov 08 13:52:26 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:26 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:26 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:26 user nova-compute[87365]:   </os>
Nov 08 13:52:26 user nova-compute[87365]:   <features>
Nov 08 13:52:26 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:26 user nova-compute[87365]:     <apic/>
Nov 08 13:52:26 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:26 user nova-compute[87365]:   </features>
Nov 08 13:52:26 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:26 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:26 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:26 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:26 user nova-compute[87365]:   </clock>
Nov 08 13:52:26 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:26 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:26 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:26 user nova-compute[87365]:   </cpu>
Nov 08 13:52:26 user nova-compute[87365]:   <devices>
Nov 08 13:52:26 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:52:26 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:52:26 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk"/>
Nov 08 13:52:26 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:26 user nova-compute[87365]:     </disk>
Nov 08 13:52:26 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:26 user nova-compute[87365]:       <mac address="fa:16:3e:54:77:5c"/>
Nov 08 13:52:26 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:26 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:26 user nova-compute[87365]:       <target dev="tap97594d65-a5"/>
Nov 08 13:52:26 user nova-compute[87365]:     </interface>
Nov 08 13:52:26 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:26 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/console.log" append="off"/>
Nov 08 13:52:26 user nova-compute[87365]:     </serial>
Nov 08 13:52:26 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:26 user nova-compute[87365]:     <video>
Nov 08 13:52:26 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:26 user nova-compute[87365]:     </video>
Nov 08 13:52:26 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:26 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:26 user nova-compute[87365]:     </rng>
Nov 08 13:52:26 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:26 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:26 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:26 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:26 user nova-compute[87365]:   </devices>
Nov 08 13:52:26 user nova-compute[87365]: </domain>
Nov 08 13:52:26 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268076932',display_name='tempest-ServerRescueNegativeTestJSON-server-268076932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268076932',id=25,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnj3SAEJU5zWUYfvOMXZ5/A6s6v/2KL7OtTas/9rkpuK3LxvKunsr07YCvVByZsH1cggrYdae+wPjQPDV8Nc3BLpIMWZFI6QCLyWctSsOJ+VjEE8IZ1wK8d5ev+nWlw+g==',key_name='tempest-keypair-1910691992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-7tef06af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74300a84ce074dd38166c961d57071cd',uuid=f01a521f-e959-4924-9d84-930bede41ab1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG os_vif [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e776b882-d29f-5b8e-b3de-0e7e00e91a88', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97594d65-a5, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97594d65-a5, col_values=(('qos', UUID('4f5e1c31-3332-4819-b2e6-e787fd81e56b')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97594d65-a5, col_values=(('external_ids', {'iface-id': '97594d65-a575-4324-a713-6892a8a1a70b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:77:5c', 'vm-uuid': 'f01a521f-e959-4924-9d84-930bede41ab1'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: INFO os_vif [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5')
Nov 08 13:52:26 user nova-compute[87365]: INFO nova.compute.manager [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Took 12.11 seconds to build instance.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-611ea0b2-b667-4156-981b-2cbdd649ab66 tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.246s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] No VIF found with MAC fa:16:3e:54:77:5c, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance spawned successfully.
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updated VIF entry in instance network info cache for port 97594d65-a575-4324-a713-6892a8a1a70b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:52:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updating instance_info_cache with network_info: [{"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9c8f1153-fa3d-4e09-94ba-8ba3c1b839ae req-4f69313a-42dd-46df-96d1-6c118e9bfd5d service nova] Releasing lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:27 user nova-compute[87365]: INFO nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Took 10.32 seconds to spawn the instance on the hypervisor.
Nov 08 13:52:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:52:27 user nova-compute[87365]: INFO nova.compute.manager [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Took 11.97 seconds to build instance.
Nov 08 13:52:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b871466c-68d8-4de4-8dc0-30cb89653813 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.276s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:28 user nova-compute[87365]: WARNING nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 13:52:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:28 user nova-compute[87365]: WARNING nova.compute.manager [req-1635547c-dc8c-468a-be11-5f72fe822b57 req-fcb43568-6b14-4937-944c-b4d32c62f078 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 13:52:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] No waiting events found dispatching network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:30 user nova-compute[87365]: WARNING nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received unexpected event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b for instance with vm_state building and task_state spawning.
Nov 08 13:52:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] No waiting events found dispatching network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:30 user nova-compute[87365]: WARNING nova.compute.manager [req-432228e3-66e1-4949-8e1c-d37cc6f83054 req-12cc4f8e-3ce3-45c5-aa91-5f62c9a1456c service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received unexpected event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b for instance with vm_state building and task_state spawning.
Nov 08 13:52:30 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:52:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance spawned successfully.
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.objects.instance [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Trying to apply a migration context that does not seem to be set for this instance {{(pid=87365) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08c1eae3-7321-44b0-ac30-9d5d9822623f tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.179s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:52:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Instance spawned successfully.
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:52:31 user nova-compute[87365]: INFO nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Took 8.20 seconds to spawn the instance on the hypervisor.
Nov 08 13:52:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:52:32 user nova-compute[87365]: INFO nova.compute.manager [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Took 9.43 seconds to build instance.
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ba5914fa-858c-4fd6-9ef8-8b2f9d2d8498 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.596s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.301s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.322s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:52:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=24.714614868164062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:52:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 78bf22ef-27da-4b43-9da9-37de97525acc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f00c96a7-38c9-4dae-be45-7b14b3db8ae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f01a521f-e959-4924-9d84-930bede41ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:52:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.926s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:52:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:52:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:52:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:46 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 is timed out.
Nov 08 13:52:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully detached device vdb from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the live domain config.
Nov 08 13:52:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycwbFWEJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:52:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[501cd1ca-748f-43bd-bebf-4b0dcd1a1f72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:52:46 user nova-compute[87365]: No targets found.
Nov 08 13:52:46 user nova-compute[87365]: iSNS:
Nov 08 13:52:46 user nova-compute[87365]: No targets found.
Nov 08 13:52:46 user nova-compute[87365]: STATIC:
Nov 08 13:52:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:52:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:52:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:52:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:52:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:52:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:52:46 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267
Nov 08 13:52:46 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:52:46 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:52:46 user nova-compute[87365]: FIRMWARE:
Nov 08 13:52:46 user nova-compute[87365]: No targets found.
Nov 08 13:52:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:52:46 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:52:46 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f70a2-fc05-4619-b170-cd99a84f52fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d62cee-2136-44f4-8723-d31f005c2b43]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:46 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:46 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:52:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:52:46 user nova-compute[87365]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 (non-flash)
Nov 08 13:52:46 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:52:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf84c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd2420-5c8b-4345-a78c-e03e092af8d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4931f88-a8b0-485f-b697-70e6ac170828]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0909cb5a-7489-447c-ba84-11e4a985e769]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c681a878-7a20-4a79-a9cf-eb513c2b0280]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ebce26-b736-4739-9836-94ea360996a8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6c2954-1c62-4d71-9092-ace36c72c02e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260]
Nov 08 13:52:46 user nova-compute[87365]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267, portal: 172.16.0.220,3260] successful.
Nov 08 13:52:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f03b9e2f-edab-4f67-bf12-9cb001ec7267 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.075s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe1a5a-7221-4727-b868-5a71a1659532]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] <== disconnect_volume: return (413ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:52:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:52:48 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'flavor' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f187bc69-ffa3-4c9b-a0d1-93fed08be611 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.464s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-faf7d23b-ddf9-4f6b-a876-627c5c2b1619" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-faf7d23b-ddf9-4f6b-a876-627c5c2b1619" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.objects.instance [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'flavor' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface> {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface> {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Attempting to detach device tapfaf7d23b-dd from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] detach device xml: <interface type="ethernet">
Nov 08 13:52:49 user nova-compute[87365]:   <mac address="fa:16:3e:9c:65:6f"/>
Nov 08 13:52:49 user nova-compute[87365]:   <model type="virtio"/>
Nov 08 13:52:49 user nova-compute[87365]:   <mtu size="1442"/>
Nov 08 13:52:49 user nova-compute[87365]:   <target dev="tapfaf7d23b-dd"/>
Nov 08 13:52:49 user nova-compute[87365]: </interface>
Nov 08 13:52:49 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface> {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 13:52:49 user nova-compute[87365]:   <name>instance-00000015</name>
Nov 08 13:52:49 user nova-compute[87365]:   <uuid>6b61eb52-9ddd-4948-a037-4db6d2d779e6</uuid>
Nov 08 13:52:49 user nova-compute[87365]:   <metadata>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:49 user nova-compute[87365]:   <nova:package version="0.0.0"/>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:name>tempest-device-tagging-server-401134231</nova:name>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:creationTime>2023-11-08 13:51:37</nova:creationTime>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:flavor name="m1.tiny">
Nov 08 13:52:49 user nova-compute[87365]:     <nova:memory>512</nova:memory>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:disk>1</nova:disk>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:swap>0</nova:swap>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:49 user nova-compute[87365]:   </nova:flavor>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:owner>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:user uuid="36139bf35e1f4f68bca23eda26b58ed8">tempest-TaggedAttachmentsTest-1724451289-project-member</nova:user>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:project uuid="daa29529fcf8483ca51cc68454c9071d">tempest-TaggedAttachmentsTest-1724451289</nova:project>
Nov 08 13:52:49 user nova-compute[87365]:   </nova:owner>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:49 user nova-compute[87365]:   <nova:ports>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:port uuid="da26a3d5-6b7b-496a-bbb9-a870e543d816">
Nov 08 13:52:49 user nova-compute[87365]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:52:49 user nova-compute[87365]:     </nova:port>
Nov 08 13:52:49 user nova-compute[87365]:     <nova:port uuid="faf7d23b-ddf9-4f6b-a876-627c5c2b1619">
Nov 08 13:52:49 user nova-compute[87365]:       <nova:ip type="fixed" address="10.10.10.151" ipVersion="4"/>
Nov 08 13:52:49 user nova-compute[87365]:     </nova:port>
Nov 08 13:52:49 user nova-compute[87365]:   </nova:ports>
Nov 08 13:52:49 user nova-compute[87365]: </nova:instance>
Nov 08 13:52:49 user nova-compute[87365]:   </metadata>
Nov 08 13:52:49 user nova-compute[87365]:   <memory unit='KiB'>524288</memory>
Nov 08 13:52:49 user nova-compute[87365]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 13:52:49 user nova-compute[87365]:   <vcpu placement='static'>1</vcpu>
Nov 08 13:52:49 user nova-compute[87365]:   <resource>
Nov 08 13:52:49 user nova-compute[87365]:     <partition>/machine</partition>
Nov 08 13:52:49 user nova-compute[87365]:   </resource>
Nov 08 13:52:49 user nova-compute[87365]:   <sysinfo type='smbios'>
Nov 08 13:52:49 user nova-compute[87365]:     <system>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='version'>0.0.0</entry>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='serial'>6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='uuid'>6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:52:49 user nova-compute[87365]:       <entry name='family'>Virtual Machine</entry>
Nov 08 13:52:49 user nova-compute[87365]:     </system>
Nov 08 13:52:49 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:49 user nova-compute[87365]:   <os>
Nov 08 13:52:49 user nova-compute[87365]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 13:52:49 user nova-compute[87365]:     <boot dev='hd'/>
Nov 08 13:52:49 user nova-compute[87365]:     <smbios mode='sysinfo'/>
Nov 08 13:52:49 user nova-compute[87365]:   </os>
Nov 08 13:52:49 user nova-compute[87365]:   <features>
Nov 08 13:52:49 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:49 user nova-compute[87365]:     <apic/>
Nov 08 13:52:49 user nova-compute[87365]:     <vmcoreinfo state='on'/>
Nov 08 13:52:49 user nova-compute[87365]:   </features>
Nov 08 13:52:49 user nova-compute[87365]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 13:52:49 user nova-compute[87365]:     <model fallback='forbid'>Nehalem</model>
Nov 08 13:52:49 user nova-compute[87365]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 13:52:49 user nova-compute[87365]:     <feature policy='require' name='vme'/>
Nov 08 13:52:49 user nova-compute[87365]:     <feature policy='require' name='x2apic'/>
Nov 08 13:52:49 user nova-compute[87365]:     <feature policy='require' name='hypervisor'/>
Nov 08 13:52:49 user nova-compute[87365]:   </cpu>
Nov 08 13:52:49 user nova-compute[87365]:   <clock offset='utc'>
Nov 08 13:52:49 user nova-compute[87365]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 13:52:49 user nova-compute[87365]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 13:52:49 user nova-compute[87365]:     <timer name='hpet' present='no'/>
Nov 08 13:52:49 user nova-compute[87365]:   </clock>
Nov 08 13:52:49 user nova-compute[87365]:   <on_poweroff>destroy</on_poweroff>
Nov 08 13:52:49 user nova-compute[87365]:   <on_reboot>restart</on_reboot>
Nov 08 13:52:49 user nova-compute[87365]:   <on_crash>destroy</on_crash>
Nov 08 13:52:49 user nova-compute[87365]:   <devices>
Nov 08 13:52:49 user nova-compute[87365]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 13:52:49 user nova-compute[87365]:     <disk type='file' device='disk'>
Nov 08 13:52:49 user nova-compute[87365]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 13:52:49 user nova-compute[87365]:       <source file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk' index='2'/>
Nov 08 13:52:49 user nova-compute[87365]:       <backingStore type='file' index='3'>
Nov 08 13:52:49 user nova-compute[87365]:         <format type='raw'/>
Nov 08 13:52:49 user nova-compute[87365]:         <source file='/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3'/>
Nov 08 13:52:49 user nova-compute[87365]:         <backingStore/>
Nov 08 13:52:49 user nova-compute[87365]:       </backingStore>
Nov 08 13:52:49 user nova-compute[87365]:       <target dev='vda' bus='virtio'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='virtio-disk0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </disk>
Nov 08 13:52:49 user nova-compute[87365]:     <disk type='file' device='cdrom'>
Nov 08 13:52:49 user nova-compute[87365]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 13:52:49 user nova-compute[87365]:       <source file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config' index='1'/>
Nov 08 13:52:49 user nova-compute[87365]:       <backingStore/>
Nov 08 13:52:49 user nova-compute[87365]:       <target dev='hda' bus='ide'/>
Nov 08 13:52:49 user nova-compute[87365]:       <readonly/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='ide0-0-0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </disk>
Nov 08 13:52:49 user nova-compute[87365]:     <controller type='usb' index='0' model='none'>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='usb'/>
Nov 08 13:52:49 user nova-compute[87365]:     </controller>
Nov 08 13:52:49 user nova-compute[87365]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='pci.0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </controller>
Nov 08 13:52:49 user nova-compute[87365]:     <controller type='ide' index='0'>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='ide'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 13:52:49 user nova-compute[87365]:     </controller>
Nov 08 13:52:49 user nova-compute[87365]:     <interface type='ethernet'>
Nov 08 13:52:49 user nova-compute[87365]:       <mac address='fa:16:3e:3b:6a:39'/>
Nov 08 13:52:49 user nova-compute[87365]:       <target dev='tapda26a3d5-6b'/>
Nov 08 13:52:49 user nova-compute[87365]:       <model type='virtio'/>
Nov 08 13:52:49 user nova-compute[87365]:       <mtu size='1442'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='net0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </interface>
Nov 08 13:52:49 user nova-compute[87365]:     <interface type='ethernet'>
Nov 08 13:52:49 user nova-compute[87365]:       <mac address='fa:16:3e:9c:65:6f'/>
Nov 08 13:52:49 user nova-compute[87365]:       <target dev='tapfaf7d23b-dd'/>
Nov 08 13:52:49 user nova-compute[87365]:       <model type='virtio'/>
Nov 08 13:52:49 user nova-compute[87365]:       <mtu size='1442'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='net1'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </interface>
Nov 08 13:52:49 user nova-compute[87365]:     <serial type='pty'>
Nov 08 13:52:49 user nova-compute[87365]:       <source path='/dev/pts/8'/>
Nov 08 13:52:49 user nova-compute[87365]:       <log file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log' append='off'/>
Nov 08 13:52:49 user nova-compute[87365]:       <target type='isa-serial' port='0'>
Nov 08 13:52:49 user nova-compute[87365]:         <model name='isa-serial'/>
Nov 08 13:52:49 user nova-compute[87365]:       </target>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='serial0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </serial>
Nov 08 13:52:49 user nova-compute[87365]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 13:52:49 user nova-compute[87365]:       <source path='/dev/pts/8'/>
Nov 08 13:52:49 user nova-compute[87365]:       <log file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log' append='off'/>
Nov 08 13:52:49 user nova-compute[87365]:       <target type='serial' port='0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='serial0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </console>
Nov 08 13:52:49 user nova-compute[87365]:     <input type='mouse' bus='ps2'>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='input0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </input>
Nov 08 13:52:49 user nova-compute[87365]:     <input type='keyboard' bus='ps2'>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='input1'/>
Nov 08 13:52:49 user nova-compute[87365]:     </input>
Nov 08 13:52:49 user nova-compute[87365]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 13:52:49 user nova-compute[87365]:       <listen type='address' address='0.0.0.0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </graphics>
Nov 08 13:52:49 user nova-compute[87365]:     <audio id='1' type='none'/>
Nov 08 13:52:49 user nova-compute[87365]:     <video>
Nov 08 13:52:49 user nova-compute[87365]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='video0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </video>
Nov 08 13:52:49 user nova-compute[87365]:     <memballoon model='virtio'>
Nov 08 13:52:49 user nova-compute[87365]:       <stats period='10'/>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='balloon0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:49 user nova-compute[87365]:     <rng model='virtio'>
Nov 08 13:52:49 user nova-compute[87365]:       <backend model='random'>/dev/urandom</backend>
Nov 08 13:52:49 user nova-compute[87365]:       <alias name='rng0'/>
Nov 08 13:52:49 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 13:52:49 user nova-compute[87365]:     </rng>
Nov 08 13:52:49 user nova-compute[87365]:   </devices>
Nov 08 13:52:49 user nova-compute[87365]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 13:52:49 user nova-compute[87365]:     <label>libvirt-6b61eb52-9ddd-4948-a037-4db6d2d779e6</label>
Nov 08 13:52:49 user nova-compute[87365]:     <imagelabel>libvirt-6b61eb52-9ddd-4948-a037-4db6d2d779e6</imagelabel>
Nov 08 13:52:49 user nova-compute[87365]:   </seclabel>
Nov 08 13:52:49 user nova-compute[87365]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 13:52:49 user nova-compute[87365]:     <label>+64055:+108</label>
Nov 08 13:52:49 user nova-compute[87365]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 13:52:49 user nova-compute[87365]:   </seclabel>
Nov 08 13:52:49 user nova-compute[87365]: </domain>
Nov 08 13:52:49 user nova-compute[87365]:  {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 13:52:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully detached device tapfaf7d23b-dd from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the persistent domain config.
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] (1/8): Attempting to detach device tapfaf7d23b-dd with device alias net1 from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:52:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] detach device xml: <interface type="ethernet">
Nov 08 13:52:49 user nova-compute[87365]:   <mac address="fa:16:3e:9c:65:6f"/>
Nov 08 13:52:49 user nova-compute[87365]:   <model type="virtio"/>
Nov 08 13:52:49 user nova-compute[87365]:   <mtu size="1442"/>
Nov 08 13:52:49 user nova-compute[87365]:   <target dev="tapfaf7d23b-dd"/>
Nov 08 13:52:49 user nova-compute[87365]: </interface>
Nov 08 13:52:49 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Start waiting for the detach event from libvirt for device tapfaf7d23b-dd with device alias net1 for instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-unplugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-unplugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:50 user nova-compute[87365]: WARNING nova.compute.manager [req-04c77623-4792-49c8-8c83-b09b24aff7cf req-2034fc64-70e6-494c-8d61-66c1ab915b05 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-unplugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 for instance with vm_state active and task_state None.
Nov 08 13:52:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:52:52 user nova-compute[87365]: WARNING nova.compute.manager [req-c6b15992-878b-425b-8e58-cb60b6d22dc5 req-41296977-0961-4735-bb86-969f0e302d87 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 for instance with vm_state active and task_state None.
Nov 08 13:52:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:52:56 user nova-compute[87365]: INFO nova.compute.claims [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Claim successful on node user
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:52:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.policy [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99bfb420b98c45d9b13589c4b2153fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f67a8efbc924527972b7f3a4fdac0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:52:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Creating image(s)
Nov 08 13:52:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk 1073741824" returned: 0 in 0.080s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Successfully created port: 946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Cannot resize image /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Ensure instance console log exists: /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:52:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Successfully updated port: 946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-changed-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Refreshing instance network info cache due to event network-changed-946a583c-d041-4f91-a541-02e87ab1ebbe. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] Acquiring lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updating instance_info_cache with network_info: [{"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Instance network_info: |[{"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] Acquired lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Refreshing network info cache for port 946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Start _get_guest_xml network_info=[{"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:52:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-271822386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-271822386',id=26,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-6tg02682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:58Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:52:59 user nova-compute[87365]:   <uuid>bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427</uuid>
Nov 08 13:52:59 user nova-compute[87365]:   <name>instance-0000001a</name>
Nov 08 13:52:59 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:52:59 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:52:59 user nova-compute[87365]:   <metadata>
Nov 08 13:52:59 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:52:59 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-271822386</nova:name>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:52:59</nova:creationTime>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:52:59 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:52:59 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:owner>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:52:59 user nova-compute[87365]:       </nova:owner>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:52:59 user nova-compute[87365]:       <nova:ports>
Nov 08 13:52:59 user nova-compute[87365]:         <nova:port uuid="946a583c-d041-4f91-a541-02e87ab1ebbe">
Nov 08 13:52:59 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 13:52:59 user nova-compute[87365]:         </nova:port>
Nov 08 13:52:59 user nova-compute[87365]:       </nova:ports>
Nov 08 13:52:59 user nova-compute[87365]:     </nova:instance>
Nov 08 13:52:59 user nova-compute[87365]:   </metadata>
Nov 08 13:52:59 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:52:59 user nova-compute[87365]:     <system>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="serial">bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427</entry>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="uuid">bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427</entry>
Nov 08 13:52:59 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:52:59 user nova-compute[87365]:     </system>
Nov 08 13:52:59 user nova-compute[87365]:   </sysinfo>
Nov 08 13:52:59 user nova-compute[87365]:   <os>
Nov 08 13:52:59 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:52:59 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:52:59 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:52:59 user nova-compute[87365]:   </os>
Nov 08 13:52:59 user nova-compute[87365]:   <features>
Nov 08 13:52:59 user nova-compute[87365]:     <acpi/>
Nov 08 13:52:59 user nova-compute[87365]:     <apic/>
Nov 08 13:52:59 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:52:59 user nova-compute[87365]:   </features>
Nov 08 13:52:59 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:52:59 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:52:59 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:52:59 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:52:59 user nova-compute[87365]:   </clock>
Nov 08 13:52:59 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:52:59 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:52:59 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:52:59 user nova-compute[87365]:   </cpu>
Nov 08 13:52:59 user nova-compute[87365]:   <devices>
Nov 08 13:52:59 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:52:59 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:52:59 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk"/>
Nov 08 13:52:59 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:52:59 user nova-compute[87365]:     </disk>
Nov 08 13:52:59 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:52:59 user nova-compute[87365]:       <mac address="fa:16:3e:38:ea:af"/>
Nov 08 13:52:59 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:59 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:52:59 user nova-compute[87365]:       <target dev="tap946a583c-d0"/>
Nov 08 13:52:59 user nova-compute[87365]:     </interface>
Nov 08 13:52:59 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:52:59 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/console.log" append="off"/>
Nov 08 13:52:59 user nova-compute[87365]:     </serial>
Nov 08 13:52:59 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:52:59 user nova-compute[87365]:     <video>
Nov 08 13:52:59 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:52:59 user nova-compute[87365]:     </video>
Nov 08 13:52:59 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:52:59 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:52:59 user nova-compute[87365]:     </rng>
Nov 08 13:52:59 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:52:59 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:52:59 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:52:59 user nova-compute[87365]:     </memballoon>
Nov 08 13:52:59 user nova-compute[87365]:   </devices>
Nov 08 13:52:59 user nova-compute[87365]: </domain>
Nov 08 13:52:59 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-271822386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-271822386',id=26,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-6tg02682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:52:58Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG os_vif [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f900fdd0-0a47-59d7-ba45-ceb11316878c', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap946a583c-d0, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap946a583c-d0, col_values=(('qos', UUID('6488f9df-627c-418a-8e7b-e81a202e1229')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap946a583c-d0, col_values=(('external_ids', {'iface-id': '946a583c-d041-4f91-a541-02e87ab1ebbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ea:af', 'vm-uuid': 'bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:52:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:52:59 user nova-compute[87365]: INFO os_vif [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0')
Nov 08 13:53:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:53:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:38:ea:af, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:53:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updated VIF entry in instance network info cache for port 946a583c-d041-4f91-a541-02e87ab1ebbe. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:53:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updating instance_info_cache with network_info: [{"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:53:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a79c1814-4695-4f2b-8685-3cea133c0198 req-b0e824b9-e285-4d67-bba0-c770fd9fd28a service nova] Releasing lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] No waiting events found dispatching network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:01 user nova-compute[87365]: WARNING nova.compute.manager [req-800cc1f9-f94a-49ca-b466-6ac4c40c05f5 req-ed84e8fb-64a2-4b34-b686-e8ceb991a1ac service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received unexpected event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe for instance with vm_state building and task_state spawning.
Nov 08 13:53:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] No waiting events found dispatching network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:03 user nova-compute[87365]: WARNING nova.compute.manager [req-8d73a9e2-9d74-46ff-82c6-3a74317836c2 req-85588346-b843-4050-8a0f-c69fd8f25061 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received unexpected event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe for instance with vm_state building and task_state spawning.
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:53:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Instance spawned successfully.
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:53:04 user nova-compute[87365]: INFO nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 08 13:53:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:53:04 user nova-compute[87365]: INFO nova.compute.manager [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Took 7.46 seconds to build instance.
Nov 08 13:53:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9b6fe200-fe4b-4a50-ac7d-1f279ce4eb3d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.605s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:07 user nova-compute[87365]: INFO nova.compute.manager [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Terminating instance
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-unplugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] No waiting events found dispatching network-vif-unplugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb740579-d097-4baa-a80d-ceeaa0218c16 req-22b7611d-616f-4236-8b26-37ddd7db71a2 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-unplugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:53:07 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Instance destroyed successfully.
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lazy-loading 'resources' on Instance uuid 78bf22ef-27da-4b43-9da9-37de97525acc {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1783992031',display_name='tempest-ServersNegativeTestJSON-server-1783992031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1783992031',id=4,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c9ea00630e945f9864ee305176c45c8',ramdisk_id='',reservation_id='r-j5ae660m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-868089155',owner_user_name='tempest-ServersNegativeTestJSON-868089155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:43:49Z,user_data=None,user_id='e8fc23eee9e94d759b90e2b9308d1d29',uuid=78bf22ef-27da-4b43-9da9-37de97525acc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converting VIF {"id": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "address": "fa:16:3e:4b:0e:20", "network": {"id": "17804042-df70-45cc-afd1-f6b9ed59791d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1635335239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ea00630e945f9864ee305176c45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7a115f9-b6", "ovs_interfaceid": "e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG os_vif [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7a115f9-b6, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a60e7cf-dcb0-4900-aaaf-84a9e4e25684) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:07 user nova-compute[87365]: INFO os_vif [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:20,bridge_name='br-int',has_traffic_filtering=True,id=e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58,network=Network(17804042-df70-45cc-afd1-f6b9ed59791d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7a115f9-b6')
Nov 08 13:53:07 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Deleting instance files /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc_del
Nov 08 13:53:07 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Deletion of /opt/stack/data/nova/instances/78bf22ef-27da-4b43-9da9-37de97525acc_del complete
Nov 08 13:53:08 user nova-compute[87365]: INFO nova.compute.manager [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 13:53:08 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:53:08 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:53:08 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:53:08 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:53:08 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Took 0.54 seconds to deallocate network for instance.
Nov 08 13:53:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:09 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Deleted allocations for instance 78bf22ef-27da-4b43-9da9-37de97525acc
Nov 08 13:53:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c0f89a04-b4d2-441f-9a30-30c80a8f6907 tempest-ServersNegativeTestJSON-868089155 tempest-ServersNegativeTestJSON-868089155-project-member] Lock "78bf22ef-27da-4b43-9da9-37de97525acc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] Acquiring lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] Lock "78bf22ef-27da-4b43-9da9-37de97525acc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] No waiting events found dispatching network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:09 user nova-compute[87365]: WARNING nova.compute.manager [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received unexpected event network-vif-plugged-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 for instance with vm_state deleted and task_state None.
Nov 08 13:53:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-6acf62a3-1c1a-4c4b-91fe-3a4582e82a26 req-2ec0dd2b-ee72-44c4-a1e9-786ad99b20e7 service nova] [instance: 78bf22ef-27da-4b43-9da9-37de97525acc] Received event network-vif-deleted-e7a115f9-b6b0-4740-b64f-ed4e9d7a2a58 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:10 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Waiting for libvirt event about the detach of device tapfaf7d23b-dd with device alias net1 from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 is timed out.
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface> {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9c:65:6f"/><model type="virtio"/><mtu size="1442"/><target dev="tapfaf7d23b-dd"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 13:53:10 user nova-compute[87365]:   <name>instance-00000015</name>
Nov 08 13:53:10 user nova-compute[87365]:   <uuid>6b61eb52-9ddd-4948-a037-4db6d2d779e6</uuid>
Nov 08 13:53:10 user nova-compute[87365]:   <metadata>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:53:10 user nova-compute[87365]:   <nova:package version="0.0.0"/>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:name>tempest-device-tagging-server-401134231</nova:name>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:creationTime>2023-11-08 13:51:37</nova:creationTime>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:flavor name="m1.tiny">
Nov 08 13:53:10 user nova-compute[87365]:     <nova:memory>512</nova:memory>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:disk>1</nova:disk>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:swap>0</nova:swap>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:vcpus>1</nova:vcpus>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:flavor>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:owner>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:user uuid="36139bf35e1f4f68bca23eda26b58ed8">tempest-TaggedAttachmentsTest-1724451289-project-member</nova:user>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:project uuid="daa29529fcf8483ca51cc68454c9071d">tempest-TaggedAttachmentsTest-1724451289</nova:project>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:owner>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:ports>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:port uuid="da26a3d5-6b7b-496a-bbb9-a870e543d816">
Nov 08 13:53:10 user nova-compute[87365]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:53:10 user nova-compute[87365]:     </nova:port>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:port uuid="faf7d23b-ddf9-4f6b-a876-627c5c2b1619">
Nov 08 13:53:10 user nova-compute[87365]:       <nova:ip type="fixed" address="10.10.10.151" ipVersion="4"/>
Nov 08 13:53:10 user nova-compute[87365]:     </nova:port>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:ports>
Nov 08 13:53:10 user nova-compute[87365]: </nova:instance>
Nov 08 13:53:10 user nova-compute[87365]:   </metadata>
Nov 08 13:53:10 user nova-compute[87365]:   <memory unit='KiB'>524288</memory>
Nov 08 13:53:10 user nova-compute[87365]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 13:53:10 user nova-compute[87365]:   <vcpu placement='static'>1</vcpu>
Nov 08 13:53:10 user nova-compute[87365]:   <resource>
Nov 08 13:53:10 user nova-compute[87365]:     <partition>/machine</partition>
Nov 08 13:53:10 user nova-compute[87365]:   </resource>
Nov 08 13:53:10 user nova-compute[87365]:   <sysinfo type='smbios'>
Nov 08 13:53:10 user nova-compute[87365]:     <system>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='version'>0.0.0</entry>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='serial'>6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='uuid'>6b61eb52-9ddd-4948-a037-4db6d2d779e6</entry>
Nov 08 13:53:10 user nova-compute[87365]:       <entry name='family'>Virtual Machine</entry>
Nov 08 13:53:10 user nova-compute[87365]:     </system>
Nov 08 13:53:10 user nova-compute[87365]:   </sysinfo>
Nov 08 13:53:10 user nova-compute[87365]:   <os>
Nov 08 13:53:10 user nova-compute[87365]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 13:53:10 user nova-compute[87365]:     <boot dev='hd'/>
Nov 08 13:53:10 user nova-compute[87365]:     <smbios mode='sysinfo'/>
Nov 08 13:53:10 user nova-compute[87365]:   </os>
Nov 08 13:53:10 user nova-compute[87365]:   <features>
Nov 08 13:53:10 user nova-compute[87365]:     <acpi/>
Nov 08 13:53:10 user nova-compute[87365]:     <apic/>
Nov 08 13:53:10 user nova-compute[87365]:     <vmcoreinfo state='on'/>
Nov 08 13:53:10 user nova-compute[87365]:   </features>
Nov 08 13:53:10 user nova-compute[87365]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 13:53:10 user nova-compute[87365]:     <model fallback='forbid'>Nehalem</model>
Nov 08 13:53:10 user nova-compute[87365]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 13:53:10 user nova-compute[87365]:     <feature policy='require' name='vme'/>
Nov 08 13:53:10 user nova-compute[87365]:     <feature policy='require' name='x2apic'/>
Nov 08 13:53:10 user nova-compute[87365]:     <feature policy='require' name='hypervisor'/>
Nov 08 13:53:10 user nova-compute[87365]:   </cpu>
Nov 08 13:53:10 user nova-compute[87365]:   <clock offset='utc'>
Nov 08 13:53:10 user nova-compute[87365]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 13:53:10 user nova-compute[87365]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 13:53:10 user nova-compute[87365]:     <timer name='hpet' present='no'/>
Nov 08 13:53:10 user nova-compute[87365]:   </clock>
Nov 08 13:53:10 user nova-compute[87365]:   <on_poweroff>destroy</on_poweroff>
Nov 08 13:53:10 user nova-compute[87365]:   <on_reboot>restart</on_reboot>
Nov 08 13:53:10 user nova-compute[87365]:   <on_crash>destroy</on_crash>
Nov 08 13:53:10 user nova-compute[87365]:   <devices>
Nov 08 13:53:10 user nova-compute[87365]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 13:53:10 user nova-compute[87365]:     <disk type='file' device='disk'>
Nov 08 13:53:10 user nova-compute[87365]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 13:53:10 user nova-compute[87365]:       <source file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk' index='2'/>
Nov 08 13:53:10 user nova-compute[87365]:       <backingStore type='file' index='3'>
Nov 08 13:53:10 user nova-compute[87365]:         <format type='raw'/>
Nov 08 13:53:10 user nova-compute[87365]:         <source file='/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3'/>
Nov 08 13:53:10 user nova-compute[87365]:         <backingStore/>
Nov 08 13:53:10 user nova-compute[87365]:       </backingStore>
Nov 08 13:53:10 user nova-compute[87365]:       <target dev='vda' bus='virtio'/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='virtio-disk0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </disk>
Nov 08 13:53:10 user nova-compute[87365]:     <disk type='file' device='cdrom'>
Nov 08 13:53:10 user nova-compute[87365]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 13:53:10 user nova-compute[87365]:       <source file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk.config' index='1'/>
Nov 08 13:53:10 user nova-compute[87365]:       <backingStore/>
Nov 08 13:53:10 user nova-compute[87365]:       <target dev='hda' bus='ide'/>
Nov 08 13:53:10 user nova-compute[87365]:       <readonly/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='ide0-0-0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </disk>
Nov 08 13:53:10 user nova-compute[87365]:     <controller type='usb' index='0' model='none'>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='usb'/>
Nov 08 13:53:10 user nova-compute[87365]:     </controller>
Nov 08 13:53:10 user nova-compute[87365]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='pci.0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </controller>
Nov 08 13:53:10 user nova-compute[87365]:     <controller type='ide' index='0'>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='ide'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 13:53:10 user nova-compute[87365]:     </controller>
Nov 08 13:53:10 user nova-compute[87365]:     <interface type='ethernet'>
Nov 08 13:53:10 user nova-compute[87365]:       <mac address='fa:16:3e:3b:6a:39'/>
Nov 08 13:53:10 user nova-compute[87365]:       <target dev='tapda26a3d5-6b'/>
Nov 08 13:53:10 user nova-compute[87365]:       <model type='virtio'/>
Nov 08 13:53:10 user nova-compute[87365]:       <mtu size='1442'/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='net0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </interface>
Nov 08 13:53:10 user nova-compute[87365]:     <serial type='pty'>
Nov 08 13:53:10 user nova-compute[87365]:       <source path='/dev/pts/8'/>
Nov 08 13:53:10 user nova-compute[87365]:       <log file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log' append='off'/>
Nov 08 13:53:10 user nova-compute[87365]:       <target type='isa-serial' port='0'>
Nov 08 13:53:10 user nova-compute[87365]:         <model name='isa-serial'/>
Nov 08 13:53:10 user nova-compute[87365]:       </target>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='serial0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </serial>
Nov 08 13:53:10 user nova-compute[87365]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 13:53:10 user nova-compute[87365]:       <source path='/dev/pts/8'/>
Nov 08 13:53:10 user nova-compute[87365]:       <log file='/opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/console.log' append='off'/>
Nov 08 13:53:10 user nova-compute[87365]:       <target type='serial' port='0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='serial0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </console>
Nov 08 13:53:10 user nova-compute[87365]:     <input type='mouse' bus='ps2'>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='input0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </input>
Nov 08 13:53:10 user nova-compute[87365]:     <input type='keyboard' bus='ps2'>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='input1'/>
Nov 08 13:53:10 user nova-compute[87365]:     </input>
Nov 08 13:53:10 user nova-compute[87365]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 13:53:10 user nova-compute[87365]:       <listen type='address' address='0.0.0.0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </graphics>
Nov 08 13:53:10 user nova-compute[87365]:     <audio id='1' type='none'/>
Nov 08 13:53:10 user nova-compute[87365]:     <video>
Nov 08 13:53:10 user nova-compute[87365]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='video0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </video>
Nov 08 13:53:10 user nova-compute[87365]:     <memballoon model='virtio'>
Nov 08 13:53:10 user nova-compute[87365]:       <stats period='10'/>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='balloon0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </memballoon>
Nov 08 13:53:10 user nova-compute[87365]:     <rng model='virtio'>
Nov 08 13:53:10 user nova-compute[87365]:       <backend model='random'>/dev/urandom</backend>
Nov 08 13:53:10 user nova-compute[87365]:       <alias name='rng0'/>
Nov 08 13:53:10 user nova-compute[87365]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 13:53:10 user nova-compute[87365]:     </rng>
Nov 08 13:53:10 user nova-compute[87365]:   </devices>
Nov 08 13:53:10 user nova-compute[87365]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 13:53:10 user nova-compute[87365]:     <label>libvirt-6b61eb52-9ddd-4948-a037-4db6d2d779e6</label>
Nov 08 13:53:10 user nova-compute[87365]:     <imagelabel>libvirt-6b61eb52-9ddd-4948-a037-4db6d2d779e6</imagelabel>
Nov 08 13:53:10 user nova-compute[87365]:   </seclabel>
Nov 08 13:53:10 user nova-compute[87365]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 13:53:10 user nova-compute[87365]:     <label>+64055:+108</label>
Nov 08 13:53:10 user nova-compute[87365]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 13:53:10 user nova-compute[87365]:   </seclabel>
Nov 08 13:53:10 user nova-compute[87365]: </domain>
Nov 08 13:53:10 user nova-compute[87365]:  {{(pid=87365) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 13:53:10 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully detached device tapfaf7d23b-dd from instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 from the live domain config.
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "address": "fa:16:3e:9c:65:6f", "network": {"id": "4ca790e8-54cd-4377-9984-1c35add6e285", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1186416904", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaf7d23b-dd", "ovs_interfaceid": "faf7d23b-ddf9-4f6b-a876-627c5c2b1619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG os_vif [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaf7d23b-dd, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76397e97-2b3c-4f1c-b4f5-2b99a4b09c7e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:10 user nova-compute[87365]: INFO os_vif [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:65:6f,bridge_name='br-int',has_traffic_filtering=True,id=faf7d23b-ddf9-4f6b-a876-627c5c2b1619,network=Network(4ca790e8-54cd-4377-9984-1c35add6e285),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaf7d23b-dd')
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:53:10 user nova-compute[87365]:   <nova:package version="0.0.0"/>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:name>tempest-device-tagging-server-401134231</nova:name>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:creationTime>2023-11-08 13:53:10</nova:creationTime>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:flavor name="m1.tiny">
Nov 08 13:53:10 user nova-compute[87365]:     <nova:memory>512</nova:memory>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:disk>1</nova:disk>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:swap>0</nova:swap>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:vcpus>1</nova:vcpus>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:flavor>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:owner>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:user uuid="36139bf35e1f4f68bca23eda26b58ed8">tempest-TaggedAttachmentsTest-1724451289-project-member</nova:user>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:project uuid="daa29529fcf8483ca51cc68454c9071d">tempest-TaggedAttachmentsTest-1724451289</nova:project>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:owner>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:53:10 user nova-compute[87365]:   <nova:ports>
Nov 08 13:53:10 user nova-compute[87365]:     <nova:port uuid="da26a3d5-6b7b-496a-bbb9-a870e543d816">
Nov 08 13:53:10 user nova-compute[87365]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 13:53:10 user nova-compute[87365]:     </nova:port>
Nov 08 13:53:10 user nova-compute[87365]:   </nova:ports>
Nov 08 13:53:10 user nova-compute[87365]: </nova:instance>
Nov 08 13:53:10 user nova-compute[87365]:  {{(pid=87365) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquired lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:53:10 user nova-compute[87365]: DEBUG nova.network.neutron [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:53:11 user nova-compute[87365]: INFO nova.network.neutron [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Port faf7d23b-ddf9-4f6b-a876-627c5c2b1619 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 08 13:53:11 user nova-compute[87365]: DEBUG nova.network.neutron [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [{"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:53:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Releasing lock "refresh_cache-6b61eb52-9ddd-4948-a037-4db6d2d779e6" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:53:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-00c28278-a210-45cb-af98-b7015e07011a tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "interface-6b61eb52-9ddd-4948-a037-4db6d2d779e6-faf7d23b-ddf9-4f6b-a876-627c5c2b1619" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.723s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-08acb074-0034-43f3-8a12-718fb9064f9e req-40ce554f-2b9a-449f-bfde-d0b711b29cb0 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-deleted-faf7d23b-ddf9-4f6b-a876-627c5c2b1619 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:53:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:30 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:53:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:53:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:53:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:53:38 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7011MB free_disk=24.589542388916016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 7487ebe0-531a-47c4-9728-3e67d9af1909 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f00c96a7-38c9-4dae-be45-7b14b3db8ae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f01a521f-e959-4924-9d84-930bede41ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:53:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:53:39 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:53:39 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:53:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:53:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:40 user nova-compute[87365]: INFO nova.compute.manager [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Terminating instance
Nov 08 13:53:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-unplugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-unplugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-fdb6dd1b-2a44-43ce-b7cd-8598e706c64d req-8f789563-4c6f-4504-bf69-c1896790ae8c service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-unplugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [{"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-8ae2c4a4-aff6-4be8-be12-9e1df495c20e" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Instance destroyed successfully.
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.objects.instance [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lazy-loading 'resources' on Instance uuid 6b61eb52-9ddd-4948-a037-4db6d2d779e6 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-401134231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-401134231',id=21,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJG3BMhQldsULcK10zgpvW/b7K1fICZ/KJdXnhajvN2z7C2B1X5SbuGdMUjZ3HPRINDlTONRMQr/eri8MLqro2nnC+zr49wQjNEPscAL8bVJ84OofQjgOK58iLxuL+Tkw==',key_name='tempest-keypair-2080785372',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa29529fcf8483ca51cc68454c9071d',ramdisk_id='',reservation_id='r-njp2po34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1724451289',owner_user_name='tempest-TaggedAttachmentsTest-1724451289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36139bf35e1f4f68bca23eda26b58ed8',uuid=6b61eb52-9ddd-4948-a037-4db6d2d779e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converting VIF {"id": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "address": "fa:16:3e:3b:6a:39", "network": {"id": "4e9801db-f697-46c3-8711-0bbe8b8e86ac", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1447739659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa29529fcf8483ca51cc68454c9071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda26a3d5-6b", "ovs_interfaceid": "da26a3d5-6b7b-496a-bbb9-a870e543d816", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG os_vif [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda26a3d5-6b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82cef190-8294-48d1-8751-cb2525b3cfb5) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:41 user nova-compute[87365]: INFO os_vif [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:6a:39,bridge_name='br-int',has_traffic_filtering=True,id=da26a3d5-6b7b-496a-bbb9-a870e543d816,network=Network(4e9801db-f697-46c3-8711-0bbe8b8e86ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda26a3d5-6b')
Nov 08 13:53:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Deleting instance files /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6_del
Nov 08 13:53:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Deletion of /opt/stack/data/nova/instances/6b61eb52-9ddd-4948-a037-4db6d2d779e6_del complete
Nov 08 13:53:41 user nova-compute[87365]: INFO nova.compute.manager [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 13:53:41 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:53:41 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:53:42 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:53:42 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Took 0.84 seconds to deallocate network for instance.
Nov 08 13:53:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-c88710b7-0987-4936-a59a-91fc2c1993ae req-009172bc-3502-45ec-b46b-3ff739a5cc66 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-deleted-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:42 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:53:42 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:43 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Deleted allocations for instance 6b61eb52-9ddd-4948-a037-4db6d2d779e6
Nov 08 13:53:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-215c7de9-c738-4000-8e60-c2d271d8e677 tempest-TaggedAttachmentsTest-1724451289 tempest-TaggedAttachmentsTest-1724451289-project-member] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] Acquiring lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] Lock "6b61eb52-9ddd-4948-a037-4db6d2d779e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:53:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] No waiting events found dispatching network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:53:43 user nova-compute[87365]: WARNING nova.compute.manager [req-f8ef5fe9-f5aa-44bf-8131-3aa1c8f748bc req-7dde8d95-7962-4ceb-985b-818e3693f937 service nova] [instance: 6b61eb52-9ddd-4948-a037-4db6d2d779e6] Received unexpected event network-vif-plugged-da26a3d5-6b7b-496a-bbb9-a870e543d816 for instance with vm_state deleted and task_state None.
Nov 08 13:53:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:53:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:53:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:04 user nova-compute[87365]: INFO nova.compute.manager [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Terminating instance
Nov 08 13:54:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-unplugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] No waiting events found dispatching network-vif-unplugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-3937473f-9752-418d-bc38-993d795d8d63 req-9e048a68-6384-413a-a744-ed3d8682e1f7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-unplugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:54:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Instance destroyed successfully.
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lazy-loading 'resources' on Instance uuid f00c96a7-38c9-4dae-be45-7b14b3db8ae9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-331879792',display_name='tempest-VolumesNegativeTest-instance-331879792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-331879792',id=23,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='556c0d0130234d60b855c506902fa06a',ramdisk_id='',reservation_id='r-wn4vdqpk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-877281963',owner_user_name='tempest-VolumesNegativeTest-877281963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:52:27Z,user_data=None,user_id='dcd7df777ca44c238e448e808092dc16',uuid=f00c96a7-38c9-4dae-be45-7b14b3db8ae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converting VIF {"id": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "address": "fa:16:3e:46:32:d0", "network": {"id": "53cd893a-f4b7-46dd-895d-7a96c6790b4c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b624e3c01b514a55ad51e537a2f2f04d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b17369-87", "ovs_interfaceid": "89b17369-87fc-4de5-8ea4-84c6b2420a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG os_vif [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89b17369-87, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a0a8323-82d1-455e-96ba-842a27e040f2) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:05 user nova-compute[87365]: INFO os_vif [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:32:d0,bridge_name='br-int',has_traffic_filtering=True,id=89b17369-87fc-4de5-8ea4-84c6b2420a3c,network=Network(53cd893a-f4b7-46dd-895d-7a96c6790b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b17369-87')
Nov 08 13:54:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Deleting instance files /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9_del
Nov 08 13:54:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Deletion of /opt/stack/data/nova/instances/f00c96a7-38c9-4dae-be45-7b14b3db8ae9_del complete
Nov 08 13:54:05 user nova-compute[87365]: INFO nova.compute.manager [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 13:54:05 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-changed-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Refreshing instance network info cache due to event network-changed-1becc56c-05fc-4353-9bb9-7ed7ad36cbda. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:05 user nova-compute[87365]: DEBUG nova.network.neutron [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Refreshing network info cache for port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] Acquiring lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] No waiting events found dispatching network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:06 user nova-compute[87365]: WARNING nova.compute.manager [req-fb186ef0-22d6-44b5-bbad-fb3d9a0f0de1 req-4cc9b3db-6b6d-4e70-85f3-8610d07f90c7 service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received unexpected event network-vif-plugged-89b17369-87fc-4de5-8ea4-84c6b2420a3c for instance with vm_state active and task_state deleting.
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:07 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Took 1.60 seconds to deallocate network for instance.
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a135069-2012-4cc5-9399-8f2cf2a09183 req-6786f8db-316e-4ced-b649-3a5a9cd5c4ea service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Received event network-vif-deleted-89b17369-87fc-4de5-8ea4-84c6b2420a3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:07 user nova-compute[87365]: INFO nova.compute.manager [req-0a135069-2012-4cc5-9399-8f2cf2a09183 req-6786f8db-316e-4ced-b649-3a5a9cd5c4ea service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Neutron deleted interface 89b17369-87fc-4de5-8ea4-84c6b2420a3c; detaching it from the instance and deleting it from the info cache
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-0a135069-2012-4cc5-9399-8f2cf2a09183 req-6786f8db-316e-4ced-b649-3a5a9cd5c4ea service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a135069-2012-4cc5-9399-8f2cf2a09183 req-6786f8db-316e-4ced-b649-3a5a9cd5c4ea service nova] [instance: f00c96a7-38c9-4dae-be45-7b14b3db8ae9] Detach interface failed, port_id=89b17369-87fc-4de5-8ea4-84c6b2420a3c, reason: Instance f00c96a7-38c9-4dae-be45-7b14b3db8ae9 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updated VIF entry in instance network info cache for port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6000ad3b-48c0-4a7f-b460-2f18e325c8c8 req-a15ab164-8f55-413a-8391-89792274c781 service nova] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:54:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:07 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Deleted allocations for instance f00c96a7-38c9-4dae-be45-7b14b3db8ae9
Nov 08 13:54:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d0218816-8a9e-4d49-92fd-e6101539601b tempest-VolumesNegativeTest-877281963 tempest-VolumesNegativeTest-877281963-project-member] Lock "f00c96a7-38c9-4dae-be45-7b14b3db8ae9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing instance network info cache due to event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updated VIF entry in instance network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f18d9616-983e-49ac-9879-233b1286a58d req-81a69959-13b9-4750-9a77-021ac5efc1d7 service nova] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-changed-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Refreshing instance network info cache due to event network-changed-97594d65-a575-4324-a713-6892a8a1a70b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] Acquiring lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] Acquired lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Refreshing network info cache for port 97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'flavor' on Instance uuid f01a521f-e959-4924-9d84-930bede41ab1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:14 user nova-compute[87365]: INFO nova.compute.manager [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Attaching volume ca857626-fb12-4984-9124-3082a2afcb23 to /dev/vdb
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.utils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG nova.network.neutron [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updated VIF entry in instance network info cache for port 97594d65-a575-4324-a713-6892a8a1a70b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG nova.network.neutron [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updating instance_info_cache with network_info: [{"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd5ec7-a505-46e0-8ddf-33eb573c61d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-45b51ec0-d76c-43cc-8040-a3ad085274c5 req-3ba417a7-ea61-4702-962b-4abd94290397 service nova] Releasing lock "refresh_cache-f01a521f-e959-4924-9d84-930bede41ab1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a3299f-e677-424c-8588-d10e8ec8c2eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[76861a83-681f-46a0-9ada-d4b30c4732e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27218f7e-2c47-417f-a463-c259a56eb3e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:54:14 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:54:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b28995-7c01-4771-8d7e-853ec9fd2d4f]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG os_brick.utils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:54:14 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updating existing volume attachment record: 883ddf1a-97d3-4025-8461-de540f19a79e {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:54:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.005s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:15 user nova-compute[87365]: INFO nova.compute.manager [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Shelving
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:16 user nova-compute[87365]: WARNING nova.compute.manager [req-be005ad9-0f13-495c-b19b-eef116a2a58d req-05b4dea2-866c-4e42-aeed-eaa4bffe7671 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state active and task_state shelving.
Nov 08 13:54:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance destroyed successfully.
Nov 08 13:54:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Beginning cold snapshot process
Nov 08 13:54:16 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:54:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk /opt/stack/data/nova/instances/snapshots/tmp0c57h__6/1d37f7b683184035896d44695915d2b2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk /opt/stack/data/nova/instances/snapshots/tmp0c57h__6/1d37f7b683184035896d44695915d2b2" returned: 0 in 1.079s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:17 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Snapshot extracted, beginning image upload
Nov 08 13:54:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:18 user nova-compute[87365]: WARNING nova.compute.manager [req-4ec49a49-fad5-4559-8842-487427d3ddf6 req-d56fb87b-ae54-4edb-83e5-3120269730ff service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:18 user nova-compute[87365]: INFO nova.compute.manager [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Terminating instance
Nov 08 13:54:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Instance destroyed successfully.
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.objects.instance [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lazy-loading 'resources' on Instance uuid 7487ebe0-531a-47c4-9728-3e67d9af1909 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:48:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-18149678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-679063459',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3qPhCuvxxSCXCVmO/9d9fB3rucw+IcGUHNQ58iFcXEFX5xhFdpweUaW8LmsoNBlNlESXZasOCpbW+JU8gxLhpFpkYBth7iF+RpbBAc2i0qK2OU1FXeezsRUzxkKQ+hQg==',key_name='tempest-keypair-554866140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa81d579f8d14baa86b0279e7cf22974',ramdisk_id='',reservation_id='r-wmh3cqtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-612073398',owner_user_name='tempest-ServerActionsV293TestJSON-612073398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:52:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c385effdb74adbb4b090ada3770c9c',uuid=7487ebe0-531a-47c4-9728-3e67d9af1909,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converting VIF {"id": "ebc4bfed-137f-440f-8d98-792d50d2b020", "address": "fa:16:3e:91:49:62", "network": {"id": "b1f76cd2-a8a1-4e5c-9416-0a316d410e3b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600438243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa81d579f8d14baa86b0279e7cf22974", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc4bfed-13", "ovs_interfaceid": "ebc4bfed-137f-440f-8d98-792d50d2b020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_vif [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc4bfed-13, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdbf1190-ee69-4fbe-872a-01ea2e7454e3) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:19 user nova-compute[87365]: INFO os_vif [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:49:62,bridge_name='br-int',has_traffic_filtering=True,id=ebc4bfed-137f-440f-8d98-792d50d2b020,network=Network(b1f76cd2-a8a1-4e5c-9416-0a316d410e3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc4bfed-13')
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvFjKabU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:54:19 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fe803-89bf-4d6f-b20c-921782b5806e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:54:19 user nova-compute[87365]: No targets found.
Nov 08 13:54:19 user nova-compute[87365]: iSNS:
Nov 08 13:54:19 user nova-compute[87365]: No targets found.
Nov 08 13:54:19 user nova-compute[87365]: STATIC:
Nov 08 13:54:19 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6
Nov 08 13:54:19 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:54:19 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:54:19 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:54:19 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:54:19 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:54:19 user nova-compute[87365]: FIRMWARE:
Nov 08 13:54:19 user nova-compute[87365]: No targets found.
Nov 08 13:54:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:54:19 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:54:19 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2462cb3f-3959-4ab9-8738-028724130435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abbdda-9814-4e52-aa5b-0f3c10fcb0bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:54:19 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:54:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:54:19 user nova-compute[87365]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 (non-flash)
Nov 08 13:54:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4f93b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfd8b8-4574-4bd1-962f-bdfdbeb8b82d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bdf31-d315-40ef-ab96-216278ebdbc7]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d5102-d982-4d7b-bd69-5c0d51e803f3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8927418-e7d6-4ac0-b9a0-88e1d7cb246b]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23030353034306530', '/dev/disk/by-id/scsi-1SCST_BIOd8acd525-005040e0605afcc0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d8acd525') {{(pid=99274) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 13:54:19 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23030353034306530
Nov 08 13:54:19 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd8acd525-005040e0605afcc0
Nov 08 13:54:19 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d8acd525
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[831db38d-4afd-4ac4-b838-8cfca3038252]: (4, None) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad7810-e565-48a9-b827-7d0024272755]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ae901-5333-4094-afe7-7000e5f9771f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260]
Nov 08 13:54:19 user nova-compute[87365]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6, portal: 172.16.0.220,3260] successful.
Nov 08 13:54:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d2b27e-1b0c-4c12-a936-634d295ec3c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa116fd9-60b6-4a0f-b17d-cccbd21abf66]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] <== disconnect_volume: return (371ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:54:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deleting instance files /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909_del
Nov 08 13:54:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deletion of /opt/stack/data/nova/instances/7487ebe0-531a-47c4-9728-3e67d9af1909_del complete
Nov 08 13:54:19 user nova-compute[87365]: INFO nova.compute.manager [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 08 13:54:19 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:54:19 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-unplugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Acquiring lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] No waiting events found dispatching network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:54:20 user nova-compute[87365]: WARNING nova.compute.manager [req-197f73aa-d08d-41f0-9bb4-a8bad6f408a4 req-c8f23560-7180-47d8-8126-9ed5d05f5737 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received unexpected event network-vif-plugged-ebc4bfed-137f-440f-8d98-792d50d2b020 for instance with vm_state active and task_state deleting.
Nov 08 13:54:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Snapshot image upload complete
Nov 08 13:54:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:54:21 user nova-compute[87365]: INFO nova.compute.manager [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Shelve offloading
Nov 08 13:54:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance destroyed successfully.
Nov 08 13:54:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:21 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Took 1.21 seconds to deallocate network for instance.
Nov 08 13:54:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance destroyed successfully.
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'resources' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7GSrNwtZi+QUTBs0XGg3Hyc/mamJ2jeRuv3YWc4nB5YJrJkN57xMdy0xafTS/F7WTUWxI6YxvPGxssn9C8j/b2TaZDYK5mHDa4+iy9kKSbyDkxkQjaCfp4bW+eQJVvwg==',key_name='tempest-keypair-2111570019',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T13:54:21.050676',shelved_host='user',shelved_image_id='09e9dbf1-09cb-443e-aaac-092a8e7e3791'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG os_vif [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb853533-e9, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=289dded0-6dab-44ff-ab38-612603fe76ca) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:22 user nova-compute[87365]: INFO os_vif [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9')
Nov 08 13:54:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Deleting instance files /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9_del
Nov 08 13:54:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Deletion of /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9_del complete
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Received event network-vif-deleted-ebc4bfed-137f-440f-8d98-792d50d2b020 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing instance network info cache due to event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:54:22 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Deleted allocations for instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9
Nov 08 13:54:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<5d6ef0e9-a59a-4456-9da2-de8ee5a874f9> lazy-loaded attributes: resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:54:22 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG nova.network.neutron [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updated VIF entry in instance network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG nova.network.neutron [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeb853533-e9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6167515b-13a0-4446-9229-14f26e00c1a3 req-77dfcffb-b01c-4116-bafb-9322640bf408 service nova] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-828a7162-509f-42b7-9950-643d78fd62b6 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.197s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:23 user nova-compute[87365]: INFO nova.compute.manager [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Took 2.77 seconds to detach 1 volumes for instance.
Nov 08 13:54:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] [instance: 7487ebe0-531a-47c4-9728-3e67d9af1909] Deleting volume: 73d2b27e-1b0c-4c12-a936-634d295ec3c6 {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 13:54:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.volume.cinder [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Update attachment failed for attachment 883ddf1a-97d3-4025-8461-de540f19a79e. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Failed to attach ca857626-fb12-4984-9124-3082a2afcb23 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1] Traceback (most recent call last):
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     self._do_attach(context, instance, volume, volume_api,
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     self._volume_attach(context, volume, connector, instance,
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     connection_info = volume_api.attachment_update(
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     res = method(self, ctx, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     return method.func(obj, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     resp = self._update('/attachments/%s' % id, body)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     return self.request(url, method, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1]     raise exceptions.from_response(resp, body)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15)
Nov 08 13:54:24 user nova-compute[87365]: ERROR nova.compute.manager [instance: f01a521f-e959-4924-9d84-930bede41ab1] 
Nov 08 13:54:24 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:54:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.545s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:24 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:54:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.718s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-c189de03-197c-4fc6-a44d-4ddec53891f1 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e4bc8c9-94bf-420d-b322-2891c4cc8a15)
Nov 08 13:54:24 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 13:54:24 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Deleted allocations for instance 7487ebe0-531a-47c4-9728-3e67d9af1909
Nov 08 13:54:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-541ed126-eb3c-4b4b-8782-225082514e7e tempest-ServerActionsV293TestJSON-612073398 tempest-ServerActionsV293TestJSON-612073398-project-member] Lock "7487ebe0-531a-47c4-9728-3e67d9af1909" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.260s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:54:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:54:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:54:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:54:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=24.61127471923828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f01a521f-e959-4924-9d84-930bede41ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:54:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:54:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 0 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:54:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:54:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:54:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:54:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:48 user nova-compute[87365]: INFO nova.compute.manager [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] instance snapshotting
Nov 08 13:54:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Beginning live snapshot process
Nov 08 13:54:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa.delta 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa.delta 1073741824" returned: 0 in 0.053s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 13:54:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:54:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:54:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 13:54:50 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:54:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa.delta /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:54:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa.delta /opt/stack/data/nova/instances/snapshots/tmpmf_iy9_3/7a5b1811f85a4ea7a2ffff198c9644fa" returned: 0 in 0.521s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:54:51 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Snapshot extracted, beginning image upload
Nov 08 13:54:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:54 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Snapshot image upload complete
Nov 08 13:54:54 user nova-compute[87365]: INFO nova.compute.manager [None req-585a7a1e-721b-49a6-8d15-a5607d847498 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Took 6.57 seconds to snapshot the instance on the hypervisor.
Nov 08 13:54:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:54:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:55:15 user nova-compute[87365]: INFO nova.compute.claims [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Claim successful on node user
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:55:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:55:15 user nova-compute[87365]: DEBUG nova.policy [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf81297c449d469ea534bf463bffebb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e9fa0d537402287340da296ca1abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:55:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Creating image(s)
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "/opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "/opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.286s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.261s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk 1073741824" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:55:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Successfully created port: 837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Cannot resize image /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Ensure instance console log exists: /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:55:17 user nova-compute[87365]: INFO nova.compute.claims [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Claim successful on node user
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Successfully updated port: 837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquired lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-changed-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Refreshing instance network info cache due to event network-changed-837405a3-f0d7-4ef9-9e76-5350eb7e89ec. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] Acquiring lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:55:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updating instance_info_cache with network_info: [{"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Releasing lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Instance network_info: |[{"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] Acquired lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Refreshing network info cache for port 837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Start _get_guest_xml network_info=[{"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:55:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3457129',id=27,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHUJdLZNKkpJgxeSNbIn6T7Vut/my/dqxNFtZn2uaixPNfBFlKsfatl08XlJpijijQC6JHqFwX7wEHg0sjryrLmwoFR/4zKgT6KRv0tHL1nH/KyYavXUgkaV9kvoGkfmA==',key_name='tempest-keypair-1515098170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17e9fa0d537402287340da296ca1abd',ramdisk_id='',reservation_id='r-p4iod6l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf81297c449d469ea534bf463bffebb2',uuid=cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converting VIF {"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.objects.instance [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lazy-loading 'pci_devices' on Instance uuid cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:55:18 user nova-compute[87365]:   <uuid>cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176</uuid>
Nov 08 13:55:18 user nova-compute[87365]:   <name>instance-0000001b</name>
Nov 08 13:55:18 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:55:18 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:55:18 user nova-compute[87365]:   <metadata>
Nov 08 13:55:18 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:55:18 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907</nova:name>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:55:18</nova:creationTime>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:55:18 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:55:18 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:owner>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:user uuid="cf81297c449d469ea534bf463bffebb2">tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member</nova:user>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:project uuid="c17e9fa0d537402287340da296ca1abd">tempest-TestServerVolumeAttachScenarioOldVersion-532519605</nova:project>
Nov 08 13:55:18 user nova-compute[87365]:       </nova:owner>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:55:18 user nova-compute[87365]:       <nova:ports>
Nov 08 13:55:18 user nova-compute[87365]:         <nova:port uuid="837405a3-f0d7-4ef9-9e76-5350eb7e89ec">
Nov 08 13:55:18 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 13:55:18 user nova-compute[87365]:         </nova:port>
Nov 08 13:55:18 user nova-compute[87365]:       </nova:ports>
Nov 08 13:55:18 user nova-compute[87365]:     </nova:instance>
Nov 08 13:55:18 user nova-compute[87365]:   </metadata>
Nov 08 13:55:18 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:55:18 user nova-compute[87365]:     <system>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="serial">cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176</entry>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="uuid">cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176</entry>
Nov 08 13:55:18 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:55:18 user nova-compute[87365]:     </system>
Nov 08 13:55:18 user nova-compute[87365]:   </sysinfo>
Nov 08 13:55:18 user nova-compute[87365]:   <os>
Nov 08 13:55:18 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:55:18 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:55:18 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:55:18 user nova-compute[87365]:   </os>
Nov 08 13:55:18 user nova-compute[87365]:   <features>
Nov 08 13:55:18 user nova-compute[87365]:     <acpi/>
Nov 08 13:55:18 user nova-compute[87365]:     <apic/>
Nov 08 13:55:18 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:55:18 user nova-compute[87365]:   </features>
Nov 08 13:55:18 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:55:18 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:55:18 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:55:18 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:55:18 user nova-compute[87365]:   </clock>
Nov 08 13:55:18 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:55:18 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:55:18 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:55:18 user nova-compute[87365]:   </cpu>
Nov 08 13:55:18 user nova-compute[87365]:   <devices>
Nov 08 13:55:18 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:55:18 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:55:18 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk"/>
Nov 08 13:55:18 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:55:18 user nova-compute[87365]:     </disk>
Nov 08 13:55:18 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:55:18 user nova-compute[87365]:       <mac address="fa:16:3e:24:72:b3"/>
Nov 08 13:55:18 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:18 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:55:18 user nova-compute[87365]:       <target dev="tap837405a3-f0"/>
Nov 08 13:55:18 user nova-compute[87365]:     </interface>
Nov 08 13:55:18 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:55:18 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/console.log" append="off"/>
Nov 08 13:55:18 user nova-compute[87365]:     </serial>
Nov 08 13:55:18 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:55:18 user nova-compute[87365]:     <video>
Nov 08 13:55:18 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:18 user nova-compute[87365]:     </video>
Nov 08 13:55:18 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:55:18 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:55:18 user nova-compute[87365]:     </rng>
Nov 08 13:55:18 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:55:18 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:55:18 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:55:18 user nova-compute[87365]:     </memballoon>
Nov 08 13:55:18 user nova-compute[87365]:   </devices>
Nov 08 13:55:18 user nova-compute[87365]: </domain>
Nov 08 13:55:18 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3457129',id=27,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHUJdLZNKkpJgxeSNbIn6T7Vut/my/dqxNFtZn2uaixPNfBFlKsfatl08XlJpijijQC6JHqFwX7wEHg0sjryrLmwoFR/4zKgT6KRv0tHL1nH/KyYavXUgkaV9kvoGkfmA==',key_name='tempest-keypair-1515098170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17e9fa0d537402287340da296ca1abd',ramdisk_id='',reservation_id='r-p4iod6l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf81297c449d469ea534bf463bffebb2',uuid=cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converting VIF {"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG os_vif [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5af2a7f-3fa8-5fb5-be14-dc9a37f1d34a', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap837405a3-f0, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap837405a3-f0, col_values=(('qos', UUID('157f53bd-53a6-4bb6-bb2b-f6385ebd7107')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap837405a3-f0, col_values=(('external_ids', {'iface-id': '837405a3-f0d7-4ef9-9e76-5350eb7e89ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:72:b3', 'vm-uuid': 'cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:18 user nova-compute[87365]: INFO os_vif [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0')
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:55:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Creating image(s)
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "/opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "/opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.policy [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e83098542a5b412ca87f6ee5a6c2b499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39c014336e54dcfa0d31ac286cc62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] No VIF found with MAC fa:16:3e:24:72:b3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.238s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk 1073741824" returned: 0 in 0.069s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.213s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Cannot resize image /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Ensure instance console log exists: /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.network.neutron [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updated VIF entry in instance network info cache for port 837405a3-f0d7-4ef9-9e76-5350eb7e89ec. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG nova.network.neutron [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updating instance_info_cache with network_info: [{"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-28c510cc-77f7-46e9-a419-70fa1c70b780 req-cb266714-06fc-41a6-a1cb-57d268458481 service nova] Releasing lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Successfully created port: 9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] No waiting events found dispatching network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:20 user nova-compute[87365]: WARNING nova.compute.manager [req-2fb281df-29e3-48b5-a95d-d01b72975a43 req-8434989a-e03a-4d09-a175-d745d5c945fd service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received unexpected event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec for instance with vm_state building and task_state spawning.
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Successfully updated port: 9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquired lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating instance_info_cache with network_info: [{"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Releasing lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Instance network_info: |[{"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Start _get_guest_xml network_info=[{"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:55:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642759649',display_name='tempest-VolumesSnapshotTestJSON-instance-642759649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642759649',id=28,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsah0JeYobUmweI1N9BA0GuHwlWSG55bdXzCixls7QnhOwREOHs6hxpj/DWA2EX7vtanHkHWB8ctbcz6J/oXRnh0jdIXhHiJeSG/UlvSKME1Yv7Sq2sLWE6UPjjF4Psg==',key_name='tempest-keypair-715435644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-xchun9h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=3a515a52-3292-44f6-812c-e9fed69c8c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:55:21 user nova-compute[87365]:   <uuid>3a515a52-3292-44f6-812c-e9fed69c8c98</uuid>
Nov 08 13:55:21 user nova-compute[87365]:   <name>instance-0000001c</name>
Nov 08 13:55:21 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:55:21 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:55:21 user nova-compute[87365]:   <metadata>
Nov 08 13:55:21 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:55:21 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-642759649</nova:name>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:55:21</nova:creationTime>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:55:21 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:55:21 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:owner>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:user uuid="e83098542a5b412ca87f6ee5a6c2b499">tempest-VolumesSnapshotTestJSON-1602758470-project-member</nova:user>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:project uuid="a39c014336e54dcfa0d31ac286cc62d4">tempest-VolumesSnapshotTestJSON-1602758470</nova:project>
Nov 08 13:55:21 user nova-compute[87365]:       </nova:owner>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:55:21 user nova-compute[87365]:       <nova:ports>
Nov 08 13:55:21 user nova-compute[87365]:         <nova:port uuid="9db37f62-28a7-47c5-89f4-0d121d9e504d">
Nov 08 13:55:21 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 13:55:21 user nova-compute[87365]:         </nova:port>
Nov 08 13:55:21 user nova-compute[87365]:       </nova:ports>
Nov 08 13:55:21 user nova-compute[87365]:     </nova:instance>
Nov 08 13:55:21 user nova-compute[87365]:   </metadata>
Nov 08 13:55:21 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:55:21 user nova-compute[87365]:     <system>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="serial">3a515a52-3292-44f6-812c-e9fed69c8c98</entry>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="uuid">3a515a52-3292-44f6-812c-e9fed69c8c98</entry>
Nov 08 13:55:21 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:55:21 user nova-compute[87365]:     </system>
Nov 08 13:55:21 user nova-compute[87365]:   </sysinfo>
Nov 08 13:55:21 user nova-compute[87365]:   <os>
Nov 08 13:55:21 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:55:21 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:55:21 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:55:21 user nova-compute[87365]:   </os>
Nov 08 13:55:21 user nova-compute[87365]:   <features>
Nov 08 13:55:21 user nova-compute[87365]:     <acpi/>
Nov 08 13:55:21 user nova-compute[87365]:     <apic/>
Nov 08 13:55:21 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:55:21 user nova-compute[87365]:   </features>
Nov 08 13:55:21 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:55:21 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:55:21 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:55:21 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:55:21 user nova-compute[87365]:   </clock>
Nov 08 13:55:21 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:55:21 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:55:21 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:55:21 user nova-compute[87365]:   </cpu>
Nov 08 13:55:21 user nova-compute[87365]:   <devices>
Nov 08 13:55:21 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:55:21 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:55:21 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk"/>
Nov 08 13:55:21 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:55:21 user nova-compute[87365]:     </disk>
Nov 08 13:55:21 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:55:21 user nova-compute[87365]:       <mac address="fa:16:3e:cf:8c:ec"/>
Nov 08 13:55:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:21 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:55:21 user nova-compute[87365]:       <target dev="tap9db37f62-28"/>
Nov 08 13:55:21 user nova-compute[87365]:     </interface>
Nov 08 13:55:21 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:55:21 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/console.log" append="off"/>
Nov 08 13:55:21 user nova-compute[87365]:     </serial>
Nov 08 13:55:21 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:55:21 user nova-compute[87365]:     <video>
Nov 08 13:55:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:21 user nova-compute[87365]:     </video>
Nov 08 13:55:21 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:55:21 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:55:21 user nova-compute[87365]:     </rng>
Nov 08 13:55:21 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:55:21 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:55:21 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:55:21 user nova-compute[87365]:     </memballoon>
Nov 08 13:55:21 user nova-compute[87365]:   </devices>
Nov 08 13:55:21 user nova-compute[87365]: </domain>
Nov 08 13:55:21 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642759649',display_name='tempest-VolumesSnapshotTestJSON-instance-642759649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642759649',id=28,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsah0JeYobUmweI1N9BA0GuHwlWSG55bdXzCixls7QnhOwREOHs6hxpj/DWA2EX7vtanHkHWB8ctbcz6J/oXRnh0jdIXhHiJeSG/UlvSKME1Yv7Sq2sLWE6UPjjF4Psg==',key_name='tempest-keypair-715435644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-xchun9h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=3a515a52-3292-44f6-812c-e9fed69c8c98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG os_vif [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3aba266b-db61-567a-8119-17265b73c202', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9db37f62-28, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9db37f62-28, col_values=(('qos', UUID('f628610f-0304-426a-9ffb-1fa8fc0ab0e8')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9db37f62-28, col_values=(('external_ids', {'iface-id': '9db37f62-28a7-47c5-89f4-0d121d9e504d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:8c:ec', 'vm-uuid': '3a515a52-3292-44f6-812c-e9fed69c8c98'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:55:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:21 user nova-compute[87365]: INFO os_vif [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28')
Nov 08 13:55:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No VIF found with MAC fa:16:3e:cf:8c:ec, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] No waiting events found dispatching network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:22 user nova-compute[87365]: WARNING nova.compute.manager [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received unexpected event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec for instance with vm_state building and task_state spawning.
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-changed-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Refreshing instance network info cache due to event network-changed-9db37f62-28a7-47c5-89f4-0d121d9e504d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Acquiring lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Acquired lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Refreshing network info cache for port 9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:55:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Instance spawned successfully.
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:23 user nova-compute[87365]: INFO nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:55:23 user nova-compute[87365]: INFO nova.compute.manager [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Took 8.44 seconds to build instance.
Nov 08 13:55:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-0eec79b8-6d12-4106-8ae0-9d2e0fdbb7f6 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.634s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.network.neutron [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updated VIF entry in instance network info cache for port 9db37f62-28a7-47c5-89f4-0d121d9e504d. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG nova.network.neutron [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating instance_info_cache with network_info: [{"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2cf1cb3f-9132-4470-85ff-fb3b1f14c36c req-fe9d0f74-c4f0-4343-a4b0-546c846aa986 service nova] Releasing lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] No waiting events found dispatching network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:24 user nova-compute[87365]: WARNING nova.compute.manager [req-eddfa0bf-4da4-4451-9992-2e99bc94d3c3 req-24593d6c-9f84-43b1-8bbc-ebe4a6082cc0 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received unexpected event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d for instance with vm_state building and task_state spawning.
Nov 08 13:55:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:55:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Instance spawned successfully.
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:26 user nova-compute[87365]: INFO nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Took 8.30 seconds to spawn the instance on the hypervisor.
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] No waiting events found dispatching network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:26 user nova-compute[87365]: WARNING nova.compute.manager [req-e6337b79-5f84-40d6-873e-d3be0a473948 req-f61e2332-fb59-405a-91e3-ff4c4859c054 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received unexpected event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d for instance with vm_state building and task_state spawning.
Nov 08 13:55:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:26 user nova-compute[87365]: INFO nova.compute.manager [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Took 9.42 seconds to build instance.
Nov 08 13:55:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a2f21156-7e23-4c25-8370-11efc0807f37 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.554s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:55:29 user nova-compute[87365]: INFO nova.compute.claims [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Claim successful on node user
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:55:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:55:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:55:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG nova.policy [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aed7fbc5c4f4736a2d5ac621c413c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f05f6965be17462d8c1447838b4437f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:55:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Creating image(s)
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk 1073741824" returned: 0 in 0.061s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Successfully created port: 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Cannot resize image /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Ensure instance console log exists: /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Successfully updated port: 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing instance network info cache due to event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:55:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance network_info: |[{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.neutron [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start _get_guest_xml network_info=[{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:55:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1986300821',display_name='tempest-ServerStableDeviceRescueTest-server-1986300821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1986300821',id=29,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHQNoEXYhLnfLfy+FmAgNjJ2gsqF4fOUbmjMgcGaXVrAjwSL5VYkLGh3IhSaslDmUe8724n0XH5oXkcKCzB2fA/Z8o8a7GI704gvT0QLsFUSCzkh+pIQ8xSeLNDiXWDWA==',key_name='tempest-keypair-2030627838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05f6965be17462d8c1447838b4437f6',ramdisk_id='',reservation_id='r-ov72t729',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-542592970',owner_user_name='tempest-ServerStableDeviceRescueTest-542592970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aed7fbc5c4f4736a2d5ac621c413c76',uuid=c6f0552a-24eb-4d72-8b92-49cd8da619e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converting VIF {"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.objects.instance [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:55:32 user nova-compute[87365]:   <uuid>c6f0552a-24eb-4d72-8b92-49cd8da619e9</uuid>
Nov 08 13:55:32 user nova-compute[87365]:   <name>instance-0000001d</name>
Nov 08 13:55:32 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:55:32 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:55:32 user nova-compute[87365]:   <metadata>
Nov 08 13:55:32 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:55:32 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1986300821</nova:name>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:55:32</nova:creationTime>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:55:32 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:55:32 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:owner>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:user uuid="1aed7fbc5c4f4736a2d5ac621c413c76">tempest-ServerStableDeviceRescueTest-542592970-project-member</nova:user>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:project uuid="f05f6965be17462d8c1447838b4437f6">tempest-ServerStableDeviceRescueTest-542592970</nova:project>
Nov 08 13:55:32 user nova-compute[87365]:       </nova:owner>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:55:32 user nova-compute[87365]:       <nova:ports>
Nov 08 13:55:32 user nova-compute[87365]:         <nova:port uuid="01452ad0-a98c-47bb-a3b5-3b95526facf2">
Nov 08 13:55:32 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 13:55:32 user nova-compute[87365]:         </nova:port>
Nov 08 13:55:32 user nova-compute[87365]:       </nova:ports>
Nov 08 13:55:32 user nova-compute[87365]:     </nova:instance>
Nov 08 13:55:32 user nova-compute[87365]:   </metadata>
Nov 08 13:55:32 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:55:32 user nova-compute[87365]:     <system>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="serial">c6f0552a-24eb-4d72-8b92-49cd8da619e9</entry>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="uuid">c6f0552a-24eb-4d72-8b92-49cd8da619e9</entry>
Nov 08 13:55:32 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:55:32 user nova-compute[87365]:     </system>
Nov 08 13:55:32 user nova-compute[87365]:   </sysinfo>
Nov 08 13:55:32 user nova-compute[87365]:   <os>
Nov 08 13:55:32 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:55:32 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:55:32 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:55:32 user nova-compute[87365]:   </os>
Nov 08 13:55:32 user nova-compute[87365]:   <features>
Nov 08 13:55:32 user nova-compute[87365]:     <acpi/>
Nov 08 13:55:32 user nova-compute[87365]:     <apic/>
Nov 08 13:55:32 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:55:32 user nova-compute[87365]:   </features>
Nov 08 13:55:32 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:55:32 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:55:32 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:55:32 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:55:32 user nova-compute[87365]:   </clock>
Nov 08 13:55:32 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:55:32 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:55:32 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:55:32 user nova-compute[87365]:   </cpu>
Nov 08 13:55:32 user nova-compute[87365]:   <devices>
Nov 08 13:55:32 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:55:32 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:55:32 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk"/>
Nov 08 13:55:32 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:55:32 user nova-compute[87365]:     </disk>
Nov 08 13:55:32 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:55:32 user nova-compute[87365]:       <mac address="fa:16:3e:b5:5b:ad"/>
Nov 08 13:55:32 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:32 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:55:32 user nova-compute[87365]:       <target dev="tap01452ad0-a9"/>
Nov 08 13:55:32 user nova-compute[87365]:     </interface>
Nov 08 13:55:32 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:55:32 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/console.log" append="off"/>
Nov 08 13:55:32 user nova-compute[87365]:     </serial>
Nov 08 13:55:32 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:55:32 user nova-compute[87365]:     <video>
Nov 08 13:55:32 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:55:32 user nova-compute[87365]:     </video>
Nov 08 13:55:32 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:55:32 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:55:32 user nova-compute[87365]:     </rng>
Nov 08 13:55:32 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:55:32 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:55:32 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:55:32 user nova-compute[87365]:     </memballoon>
Nov 08 13:55:32 user nova-compute[87365]:   </devices>
Nov 08 13:55:32 user nova-compute[87365]: </domain>
Nov 08 13:55:32 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1986300821',display_name='tempest-ServerStableDeviceRescueTest-server-1986300821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1986300821',id=29,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHQNoEXYhLnfLfy+FmAgNjJ2gsqF4fOUbmjMgcGaXVrAjwSL5VYkLGh3IhSaslDmUe8724n0XH5oXkcKCzB2fA/Z8o8a7GI704gvT0QLsFUSCzkh+pIQ8xSeLNDiXWDWA==',key_name='tempest-keypair-2030627838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f05f6965be17462d8c1447838b4437f6',ramdisk_id='',reservation_id='r-ov72t729',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-542592970',owner_user_name='tempest-ServerStableDeviceRescueTest-542592970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aed7fbc5c4f4736a2d5ac621c413c76',uuid=c6f0552a-24eb-4d72-8b92-49cd8da619e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converting VIF {"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG os_vif [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e58b66a-bcf8-5ad7-a5ac-cfe9e9d52e72', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01452ad0-a9, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01452ad0-a9, col_values=(('qos', UUID('f2a89bb3-991d-49e3-aaaf-2e9d81ec2bc3')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01452ad0-a9, col_values=(('external_ids', {'iface-id': '01452ad0-a98c-47bb-a3b5-3b95526facf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:5b:ad', 'vm-uuid': 'c6f0552a-24eb-4d72-8b92-49cd8da619e9'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:32 user nova-compute[87365]: INFO os_vif [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9')
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No VIF found with MAC fa:16:3e:b5:5b:ad, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.neutron [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updated VIF entry in instance network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG nova.network.neutron [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-adc2f370-c1e8-4ce4-8218-3c6ff9421703 req-8c8cf163-2d30-4680-8e2d-8752d8517903 service nova] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:34 user nova-compute[87365]: WARNING nova.compute.manager [req-6be679fd-b418-479c-910d-7468eb4f3d6c req-4b786d31-218b-4003-8e49-e03b8dc4984c service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state building and task_state spawning.
Nov 08 13:55:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:55:36 user nova-compute[87365]: WARNING nova.compute.manager [req-c2f1e290-3314-48da-a2f1-86a1a0e126a6 req-d696ce9c-bccb-4c8b-8238-3c6ccaf7a654 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state building and task_state spawning.
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:55:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance spawned successfully.
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:55:36 user nova-compute[87365]: INFO nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:55:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:55:36 user nova-compute[87365]: INFO nova.compute.manager [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Took 7.43 seconds to build instance.
Nov 08 13:55:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-28d59511-03ab-459f-a6b0-895fbd5dd1fb tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.612s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.275s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:55:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:55:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:55:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:55:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7494MB free_disk=24.536277770996094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:55:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f01a521f-e959-4924-9d84-930bede41ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:55:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:55:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:55:57 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:55:57 user nova-compute[87365]: INFO nova.compute.claims [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Claim successful on node user
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:55:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:55:58 user nova-compute[87365]: DEBUG nova.policy [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99bfb420b98c45d9b13589c4b2153fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f67a8efbc924527972b7f3a4fdac0cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:55:58 user nova-compute[87365]: INFO nova.virt.block_device [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Booting with volume-backed-image 46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd at /dev/vda
Nov 08 13:55:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Successfully created port: efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Successfully updated port: efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-changed-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Refreshing instance network info cache due to event network-changed-efd44520-0a16-40c2-b155-409224cec32f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] Acquiring lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating instance_info_cache with network_info: [{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance network_info: |[{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] Acquired lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:56:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Refreshing network info cache for port efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:56:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updated VIF entry in instance network info cache for port efd44520-0a16-40c2-b155-409224cec32f. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:56:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating instance_info_cache with network_info: [{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:56:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bf4c59b6-df0d-4540-9e0c-00cafadcef7d req-fcaaae15-2a9e-4d54-9f3c-f4c7ff4dfb5d service nova] Releasing lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:56:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'flavor' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:05 user nova-compute[87365]: INFO nova.compute.manager [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Attaching volume 32ad28e0-7d1d-4caf-89ff-4b668ed6d91e to /dev/vdb
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.utils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d815a-b8d9-491a-a313-dc32cf51acc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c14c2f-7f7c-4046-9353-0acf7048ed93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a097d9-caf5-4116-bd5f-6b44488b5734]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e9792-6b4b-4203-b802-543b73cb15f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:05 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:56:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb51470c-7fa2-4262-a132-7f2ec0bd00d8]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG os_brick.utils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:56:05 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating existing volume attachment record: 51349721-6fa7-45b2-b449-f26aeee9ae69 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:56:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:09 user nova-compute[87365]: INFO nova.compute.manager [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Unshelving
Nov 08 13:56:09 user nova-compute[87365]: INFO nova.virt.block_device [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Booting with volume 4ffd2195-3e78-4361-8ee0-440ecd321077 at /dev/vdc
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.utils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a676da5-1c85-479b-bf7a-2ccd80fb62dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[21de30b6-28d6-4100-a3c8-6d96a2790ac8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f7b4fb-4d49-4196-a505-9d4f5af801a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7490cc9-ce5b-42fc-a595-34f44df9471d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:09 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:56:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab8bd7-b7ec-4ee3-9cb9-78102675fd6c]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG os_brick.utils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:56:09 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating existing volume attachment record: 96c3926f-f4f5-4a40-a017-82b67e34ffeb {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:56:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.utils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381ec73-1533-492f-816a-9e0dfa8b810b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe98e6-5221-4835-ba97-ebace9d8138d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861cb3e-380f-43a3-840a-4e6f082ee615]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb6ec59-1875-4b2c-9be0-d6a99de3d8cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:56:19 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:56:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a126ca-7deb-4293-9cd3-b3b76dcdee34]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG os_brick.utils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:56:19 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating existing volume attachment record: bdaf05bc-5d8a-43bb-ac66-66cf63d9cef4 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:56:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:56:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:56:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:33 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:56:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:56:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:56:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:41 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:56:41 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7347MB free_disk=24.440753936767578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f01a521f-e959-4924-9d84-930bede41ab1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:56:41 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:56:42 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:56:42 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:56:42 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:56:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:56:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Creating image(s)
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Ensure instance console log exists: /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start _get_guest_xml network_info=[{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c7723ce-8e93-40d9-94f8-35767b220322', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'serial': 'ef23e653-42db-4a4a-9c18-4e5766cc4b2e'}, 'attachment_id': 'bdaf05bc-5d8a-43bb-ac66-66cf63d9cef4', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:56:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:56:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:56:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:56:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:56:43 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19569335-4e92-4f0b-9395-cfbbe35fd358]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:56:43 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc4ab7-5b21-4c1e-840c-559a26579f85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e] added
Nov 08 13:56:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[af649d7c-0c73-4e64-b1d6-6ee78415863d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[61582e9d-1f3d-4e15-9baa-4aef0844f57e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfNIzJPb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfNIzJPb" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810d5fb-93c4-4e15-bcae-c2c573e5355a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfNIzJPb'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bca64c-a6f2-4e2d-915f-626064b95d56]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2dc381-edb5-4722-a21a-f85adab525f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bed6cf-e42c-41bc-8afb-8a60a62d2682]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260]
Nov 08 13:56:44 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260] successful.
Nov 08 13:56:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a389ac03-1436-4f6b-9972-94a23d7a8292]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c491a1-c732-45d1-bc12-981744f1e74e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceafb890-9074-435e-a89e-2c702f3bf577]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:56:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23066346331646433', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066346331646433', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1675383101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1675383101',id=30,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-s5nxjo0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:58Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=3c7723ce-8e93-40d9-94f8-35767b220322,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:56:45 user nova-compute[87365]:   <uuid>3c7723ce-8e93-40d9-94f8-35767b220322</uuid>
Nov 08 13:56:45 user nova-compute[87365]:   <name>instance-0000001e</name>
Nov 08 13:56:45 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:56:45 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:56:45 user nova-compute[87365]:   <metadata>
Nov 08 13:56:45 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:56:45 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1675383101</nova:name>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:56:43</nova:creationTime>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:56:45 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:56:45 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:owner>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:56:45 user nova-compute[87365]:       </nova:owner>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:56:45 user nova-compute[87365]:       <nova:ports>
Nov 08 13:56:45 user nova-compute[87365]:         <nova:port uuid="efd44520-0a16-40c2-b155-409224cec32f">
Nov 08 13:56:45 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 13:56:45 user nova-compute[87365]:         </nova:port>
Nov 08 13:56:45 user nova-compute[87365]:       </nova:ports>
Nov 08 13:56:45 user nova-compute[87365]:     </nova:instance>
Nov 08 13:56:45 user nova-compute[87365]:   </metadata>
Nov 08 13:56:45 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:56:45 user nova-compute[87365]:     <system>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="serial">3c7723ce-8e93-40d9-94f8-35767b220322</entry>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="uuid">3c7723ce-8e93-40d9-94f8-35767b220322</entry>
Nov 08 13:56:45 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:56:45 user nova-compute[87365]:     </system>
Nov 08 13:56:45 user nova-compute[87365]:   </sysinfo>
Nov 08 13:56:45 user nova-compute[87365]:   <os>
Nov 08 13:56:45 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:56:45 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:56:45 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:56:45 user nova-compute[87365]:   </os>
Nov 08 13:56:45 user nova-compute[87365]:   <features>
Nov 08 13:56:45 user nova-compute[87365]:     <acpi/>
Nov 08 13:56:45 user nova-compute[87365]:     <apic/>
Nov 08 13:56:45 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:56:45 user nova-compute[87365]:   </features>
Nov 08 13:56:45 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:56:45 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:56:45 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:56:45 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:56:45 user nova-compute[87365]:   </clock>
Nov 08 13:56:45 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:56:45 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:56:45 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:56:45 user nova-compute[87365]:   </cpu>
Nov 08 13:56:45 user nova-compute[87365]:   <devices>
Nov 08 13:56:45 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:56:45 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:56:45 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 13:56:45 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:56:45 user nova-compute[87365]:       <serial>ef23e653-42db-4a4a-9c18-4e5766cc4b2e</serial>
Nov 08 13:56:45 user nova-compute[87365]:     </disk>
Nov 08 13:56:45 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:56:45 user nova-compute[87365]:       <mac address="fa:16:3e:04:e8:0d"/>
Nov 08 13:56:45 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:56:45 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:56:45 user nova-compute[87365]:       <target dev="tapefd44520-0a"/>
Nov 08 13:56:45 user nova-compute[87365]:     </interface>
Nov 08 13:56:45 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:56:45 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/console.log" append="off"/>
Nov 08 13:56:45 user nova-compute[87365]:     </serial>
Nov 08 13:56:45 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:56:45 user nova-compute[87365]:     <video>
Nov 08 13:56:45 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:56:45 user nova-compute[87365]:     </video>
Nov 08 13:56:45 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:56:45 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:56:45 user nova-compute[87365]:     </rng>
Nov 08 13:56:45 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:56:45 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:56:45 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:56:45 user nova-compute[87365]:     </memballoon>
Nov 08 13:56:45 user nova-compute[87365]:   </devices>
Nov 08 13:56:45 user nova-compute[87365]: </domain>
Nov 08 13:56:45 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1675383101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1675383101',id=30,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-s5nxjo0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:55:58Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=3c7723ce-8e93-40d9-94f8-35767b220322,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG os_vif [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c2b799-9f75-5ed3-b4ea-f0efea1165d2', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefd44520-0a, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefd44520-0a, col_values=(('qos', UUID('97ef3908-3825-46f5-b874-536deebc897b')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefd44520-0a, col_values=(('external_ids', {'iface-id': 'efd44520-0a16-40c2-b155-409224cec32f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:e8:0d', 'vm-uuid': '3c7723ce-8e93-40d9-94f8-35767b220322'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:45 user nova-compute[87365]: INFO os_vif [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a')
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:56:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:04:e8:0d, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:56:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:56:47 user nova-compute[87365]: WARNING nova.compute.manager [req-90be506a-396c-4c71-9271-272746bdb10f req-22804f4a-ece8-4a59-acbd-eb5b08d5a234 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state building and task_state spawning.
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:56:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance spawned successfully.
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:56:49 user nova-compute[87365]: WARNING nova.compute.manager [req-e2f55486-cd3d-4405-9353-81b073524cbc req-9d00d629-5543-4361-9122-872bd0623bb1 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state building and task_state spawning.
Nov 08 13:56:49 user nova-compute[87365]: INFO nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 08 13:56:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:56:49 user nova-compute[87365]: INFO nova.compute.manager [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Took 51.71 seconds to build instance.
Nov 08 13:56:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1dd6c6e4-b408-4ef8-bbc4-b4211862417d tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.880s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:56:54 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:56:54 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:56:54 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3026e80f-98e8-4984-a7ac-d2c82d356d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:56:54 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a465f3-e931-4b43-93dd-a98b5500a704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e] added
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8b3d7-a0c3-4399-98c6-c8b5170f105b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe4022-b486-49c7-ab6b-8b08e7aaf36f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKvDyBXG {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKvDyBXG" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[463421d2-521a-4e93-8522-c3616ed28ac6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKvDyBXG'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61b2b3e-fad6-45e3-8f0b-bb62b11bc096]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913c913-4d45-493b-b15c-6da79e091542]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_requests' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc43bc-5a5d-445a-a6af-62e2d4853c78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]
Nov 08 13:56:54 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:56:54 user nova-compute[87365]: INFO nova.compute.claims [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Claim successful on node user
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e2432-f1af-4cf8-9038-06a0879a9924]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bee984-f811-4d4e-84e1-efb959660c97]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:56:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981ef43-580f-4323-a95e-539497143466]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:56:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.952s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:55 user nova-compute[87365]: INFO nova.network.neutron [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating port eb853533-e9d7-4cec-a4fc-6185232a7b57 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26338326361663365', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338326361663365', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG nova.objects.instance [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'flavor' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:56:55 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:56:55 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:56:55 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:56:55 user nova-compute[87365]:   <serial>32ad28e0-7d1d-4caf-89ff-4b668ed6d91e</serial>
Nov 08 13:56:55 user nova-compute[87365]: </disk>
Nov 08 13:56:55 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No VIF found with MAC fa:16:3e:2f:76:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-24504820-2426-4399-995a-280ad180d6d3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.692s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing instance network info cache due to event network-changed-eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:56:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] Acquiring lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:56:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Creating image(s)
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] Acquired lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG nova.network.neutron [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Refreshing network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG nova.objects.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<5d6ef0e9-a59a-4456-9da2-de8ee5a874f9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:56:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.part --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG nova.virt.images [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] 09e9dbf1-09cb-443e-aaac-092a8e7e3791 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.part /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updated VIF entry in instance network info cache for port eb853533-e9d7-4cec-a4fc-6185232a7b57. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aff04e0b-9079-4585-b27d-1ae4caa29721 req-453daf6a-cb72-4b42-bba1-f6d773b66ff1 service nova] Releasing lock "refresh_cache-5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.part /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.converted" returned: 0 in 0.491s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.428s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:56:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Stashing vm_state: active {{(pid=87365) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json" returned: 0 in 0.239s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:57:00 user nova-compute[87365]: INFO nova.compute.claims [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Claim successful on node user
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823,backing_fmt=raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:00 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating resource usage from migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823,backing_fmt=raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk 1073741824" returned: 0 in 0.065s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "d27b4f4b0e66fccc788186b0bf26b482e9f3e823" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'migration_context' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG nova.objects.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<5d6ef0e9-a59a-4456-9da2-de8ee5a874f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:57:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Rebasing disk image.
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 -F raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.747s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:01 user nova-compute[87365]: INFO nova.compute.manager [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Migrating
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "compute-rpcapi-router" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:01 user nova-compute[87365]: INFO nova.compute.rpcapi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "compute-rpcapi-router" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Starting migrate_disk_and_power_off {{(pid=87365) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:02 user nova-compute[87365]: WARNING nova.compute.manager [req-70339709-7cf7-46cb-b6bf-52cf329532e2 req-ef261b1c-b2ec-456e-b0e3-cb09895a2a8a service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance destroyed successfully.
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG os_vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1becc56c-05, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61f89423-abd2-4280-bf79-efc8532dbc9e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: INFO os_vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05')
Nov 08 13:57:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:02 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.087s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad8770-4fa9-4604-9ee9-17152e2e2f22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:57:03 user nova-compute[87365]: No targets found.
Nov 08 13:57:03 user nova-compute[87365]: iSNS:
Nov 08 13:57:03 user nova-compute[87365]: No targets found.
Nov 08 13:57:03 user nova-compute[87365]: STATIC:
Nov 08 13:57:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:57:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:57:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:57:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:57:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:57:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:57:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e
Nov 08 13:57:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:57:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:57:03 user nova-compute[87365]: FIRMWARE:
Nov 08 13:57:03 user nova-compute[87365]: No targets found.
Nov 08 13:57:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:57:03 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:57:03 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4fc2e-5775-4b9c-93a7-c9df48c2c988]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f09ec3-8f77-4875-9c15-ed63aa93dd2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:57:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4c35510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f0916-6070-46af-b0a8-06b7a31226ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44dceb2-2bc5-4221-b6b5-07e7dc2bc44e]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[df12e251-7c5a-4f05-9618-496b82ea3ce8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ae650-13ba-45d2-9315-67908107a017]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4722c562-67e1-4b9c-b4d1-4d7c2ce1ad5c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e39fc3-f727-47a8-9cd6-7760ac64ab13]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]
Nov 08 13:57:03 user nova-compute[87365]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.
Nov 08 13:57:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c7674-fef6-441e-99c1-713ff38fc38f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.524s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== disconnect_volume: return (526ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 -F raw /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk" returned: 0 in 2.951s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Ensure instance console log exists: /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start _get_guest_xml network_info=[{"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3115d01d84b1348b689a2cb6ac7e0af9',container_format='bare',created_at=2023-11-08T13:54:16Z,direct_url=<?>,disk_format='qcow2',id=09e9dbf1-09cb-443e-aaac-092a8e7e3791,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1096987352-shelved',owner='8f9d5da6823541c282006a7871e50ca8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T13:54:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkAjsLMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5d6ef0e9-a59a-4456-9da2-de8ee5a874f9', 'attached_at': '', 'detached_at': '', 'volume_id': '4ffd2195-3e78-4361-8ee0-440ecd321077', 'serial': '4ffd2195-3e78-4361-8ee0-440ecd321077'}, 'attachment_id': '96c3926f-f4f5-4a40-a017-82b67e34ffeb', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:57:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:57:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize/disk /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3115d01d84b1348b689a2cb6ac7e0af9',container_format='bare',created_at=2023-11-08T13:54:16Z,direct_url=<?>,disk_format='qcow2',id=09e9dbf1-09cb-443e-aaac-092a8e7e3791,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1096987352-shelved',owner='8f9d5da6823541c282006a7871e50ca8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T13:54:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.objects.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<5d6ef0e9-a59a-4456-9da2-de8ee5a874f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkAjsLMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.162s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:04 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:04 user nova-compute[87365]: WARNING nova.compute.manager [req-ba4f695c-a75d-44f0-85dd-c49e3dbf1e8a req-f2876c8b-3191-46e8-bdf9-851572466ec4 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_migrating.
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260" returned: 21 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6bf5b-2654-4d22-a6b7-8fd3aaedae4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:57:04 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e9549-2baf-437b-8845-47fdc8f81c8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077] added
Nov 08 13:57:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac6cb5-e23a-497d-9e6e-db2fa60b8a8b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.158s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6341f327-0a26-4751-9cd8-231426d8620f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkAjsLMU {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkAjsLMU" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b40fa70-0653-4d75-b871-3204851212c8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkAjsLMU'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b2ad4-801a-412d-bedb-97b8a75c2371]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1baad2-6d31-4d8d-95d8-873e7dd69edf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:04 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:04 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa750638-987b-4778-959f-ceb6658d2c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260]
Nov 08 13:57:04 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260] successful.
Nov 08 13:57:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc85779-3a28-40ee-9728-97bbb46bf06a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "cp -r /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize/disk /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk" returned: 0 in 1.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize/disk.info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk.info {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9bdf9a-44b8-4b90-a982-fb77189c3356]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:05 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:05 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:05 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:05 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:05 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:05 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.744s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "cp -r /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize/disk.info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk.info" returned: 0 in 0.131s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[16433273-c526-4a95-aa91-9d25e2a92486]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:05 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-changed-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Refreshing instance network info cache due to event network-changed-837405a3-f0d7-4ef9-9e76-5350eb7e89ec. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] Acquiring lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] Acquired lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.network.neutron [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Refreshing network info cache for port 837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkAjsLMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.359s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] <== connect_volume: return (2361ms) {'type': 'block', 'scsi_wwn': '26337653133306134', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337653133306134', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='09e9dbf1-09cb-443e-aaac-092a8e7e3791',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111570019',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T13:54:21.050676',shelved_host='user',shelved_image_id='09e9dbf1-09cb-443e-aaac-092a8e7e3791'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.objects.base [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<5d6ef0e9-a59a-4456-9da2-de8ee5a874f9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:57:06 user nova-compute[87365]:   <uuid>5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</uuid>
Nov 08 13:57:06 user nova-compute[87365]:   <name>instance-00000018</name>
Nov 08 13:57:06 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:57:06 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:57:06 user nova-compute[87365]:   <metadata>
Nov 08 13:57:06 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:57:06 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1096987352</nova:name>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:57:03</nova:creationTime>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:57:06 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:57:06 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:owner>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:user uuid="3ad4efa600524c27a048bd565bf1852c">tempest-AttachVolumeShelveTestJSON-1136658600-project-member</nova:user>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:project uuid="8f9d5da6823541c282006a7871e50ca8">tempest-AttachVolumeShelveTestJSON-1136658600</nova:project>
Nov 08 13:57:06 user nova-compute[87365]:       </nova:owner>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:root type="image" uuid="09e9dbf1-09cb-443e-aaac-092a8e7e3791"/>
Nov 08 13:57:06 user nova-compute[87365]:       <nova:ports>
Nov 08 13:57:06 user nova-compute[87365]:         <nova:port uuid="eb853533-e9d7-4cec-a4fc-6185232a7b57">
Nov 08 13:57:06 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 13:57:06 user nova-compute[87365]:         </nova:port>
Nov 08 13:57:06 user nova-compute[87365]:       </nova:ports>
Nov 08 13:57:06 user nova-compute[87365]:     </nova:instance>
Nov 08 13:57:06 user nova-compute[87365]:   </metadata>
Nov 08 13:57:06 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:57:06 user nova-compute[87365]:     <system>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="serial">5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</entry>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="uuid">5d6ef0e9-a59a-4456-9da2-de8ee5a874f9</entry>
Nov 08 13:57:06 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:57:06 user nova-compute[87365]:     </system>
Nov 08 13:57:06 user nova-compute[87365]:   </sysinfo>
Nov 08 13:57:06 user nova-compute[87365]:   <os>
Nov 08 13:57:06 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:57:06 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:57:06 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:57:06 user nova-compute[87365]:   </os>
Nov 08 13:57:06 user nova-compute[87365]:   <features>
Nov 08 13:57:06 user nova-compute[87365]:     <acpi/>
Nov 08 13:57:06 user nova-compute[87365]:     <apic/>
Nov 08 13:57:06 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:57:06 user nova-compute[87365]:   </features>
Nov 08 13:57:06 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:57:06 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:57:06 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:57:06 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:57:06 user nova-compute[87365]:   </clock>
Nov 08 13:57:06 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:57:06 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:57:06 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:57:06 user nova-compute[87365]:   </cpu>
Nov 08 13:57:06 user nova-compute[87365]:   <devices>
Nov 08 13:57:06 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:57:06 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:57:06 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk"/>
Nov 08 13:57:06 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:57:06 user nova-compute[87365]:     </disk>
Nov 08 13:57:06 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:57:06 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:57:06 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 13:57:06 user nova-compute[87365]:       <target dev="vdc" bus="virtio"/>
Nov 08 13:57:06 user nova-compute[87365]:       <serial>4ffd2195-3e78-4361-8ee0-440ecd321077</serial>
Nov 08 13:57:06 user nova-compute[87365]:     </disk>
Nov 08 13:57:06 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:57:06 user nova-compute[87365]:       <mac address="fa:16:3e:cd:bb:2c"/>
Nov 08 13:57:06 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:57:06 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:57:06 user nova-compute[87365]:       <target dev="tapeb853533-e9"/>
Nov 08 13:57:06 user nova-compute[87365]:     </interface>
Nov 08 13:57:06 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:57:06 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/console.log" append="off"/>
Nov 08 13:57:06 user nova-compute[87365]:     </serial>
Nov 08 13:57:06 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:57:06 user nova-compute[87365]:     <video>
Nov 08 13:57:06 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:57:06 user nova-compute[87365]:     </video>
Nov 08 13:57:06 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:57:06 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:57:06 user nova-compute[87365]:     </rng>
Nov 08 13:57:06 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:57:06 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:57:06 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:57:06 user nova-compute[87365]:     </memballoon>
Nov 08 13:57:06 user nova-compute[87365]:   </devices>
Nov 08 13:57:06 user nova-compute[87365]: </domain>
Nov 08 13:57:06 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='09e9dbf1-09cb-443e-aaac-092a8e7e3791',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2111570019',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T13:54:21.050676',shelved_host='user',shelved_image_id='09e9dbf1-09cb-443e-aaac-092a8e7e3791'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG os_vif [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5592bbe5-2d19-584d-a858-50e374a2b0ed', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb853533-e9, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb853533-e9, col_values=(('qos', UUID('ff26de69-e126-4b25-866a-bf3e5555e24e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb853533-e9, col_values=(('external_ids', {'iface-id': 'eb853533-e9d7-4cec-a4fc-6185232a7b57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:bb:2c', 'vm-uuid': '5d6ef0e9-a59a-4456-9da2-de8ee5a874f9'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:06 user nova-compute[87365]: INFO os_vif [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9')
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No VIF found with MAC fa:16:3e:cd:bb:2c, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:57:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updated VIF entry in instance network info cache for port 837405a3-f0d7-4ef9-9e76-5350eb7e89ec. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:57:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updating instance_info_cache with network_info: [{"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-06d604bc-ee2a-43e8-9e72-80ddde2c89aa req-2c28566f-2551-4e2d-a6e2-b402470cdc6b service nova] Releasing lock "refresh_cache-cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:08 user nova-compute[87365]: WARNING nova.compute.manager [req-1891d70d-d90a-4d5a-9ed2-42fe9572c7ba req-7a33aa81-c66e-474a-b22c-16fcf0dafdb1 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-changed-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Refreshing instance network info cache due to event network-changed-9db37f62-28a7-47c5-89f4-0d121d9e504d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] Acquiring lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] Acquired lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.network.neutron [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Refreshing network info cache for port 9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Ignoring supplied device name: /dev/vdb
Nov 08 13:57:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:09 user nova-compute[87365]: INFO nova.compute.manager [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Attaching volume 219e9157-c4db-4d09-8ec3-5a090612d6b7 to /dev/vdb
Nov 08 13:57:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updated VIF entry in instance network info cache for port 9db37f62-28a7-47c5-89f4-0d121d9e504d. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating instance_info_cache with network_info: [{"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.utils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[091df309-c0ef-4cd0-ac19-5dd8374e4256]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-290c20b8-fc39-44fb-a472-9defd97e7fa0 req-a477df48-842a-4dd6-9a9f-7239698123aa service nova] Releasing lock "refresh_cache-3a515a52-3292-44f6-812c-e9fed69c8c98" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.061s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63129294-590b-46b7-bf8c-4f01d07fbc49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d809a3c4-bda2-4ad4-addd-ae72d8185f94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8012010-f94a-4ba5-a45e-85d625a5d561]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:09 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:57:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3afb3d-03ce-4bb7-ad49-cd0b18452f73]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG os_brick.utils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:09 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating existing volume attachment record: 634d6268-0f0d-4056-96fb-925b85132b7e {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:57:10 user nova-compute[87365]: DEBUG nova.compute.manager [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:10 user nova-compute[87365]: DEBUG nova.compute.manager [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:10 user nova-compute[87365]: WARNING nova.compute.manager [req-976e424d-1bab-4dfe-b2c6-158cda60e40c req-ad14f623-ef43-4e99-b6c2-c932ffd7351b service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 13:57:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:57:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:57:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance spawned successfully.
Nov 08 13:57:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:57:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c683ddce-239f-4770-a421-ab563439f902 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 62.581s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lazy-loading 'flavor' on Instance uuid cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:14 user nova-compute[87365]: INFO nova.compute.manager [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Attaching volume 45131908-6f38-4694-878f-a4793dc23694 to /dev/vdb
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.utils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5098d480-b0c2-4157-a30d-a8838021da66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36a1315-a2d4-4ce5-bedd-029386c662fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4154d-767d-45ca-96f0-ccfc41896029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb7d9a-d830-4995-8a2f-b0e2cb722508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:15 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:57:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff550c7-4446-41e6-bb5b-44e5ea9a8731]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG os_brick.utils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:15 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updating existing volume attachment record: c29ac996-1ffa-43fc-b6de-3220a1b51937 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:57:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda binding to destination host user is already ACTIVE {{(pid=87365) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing instance network info cache due to event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.utils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a7401-f13e-4ae6-bb16-235aca315f1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f05da-71a6-4ad7-b0c7-1d319607dadb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updated VIF entry in instance network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eaf292-f5cf-49de-931e-ca2a57a9e3fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe8ccc-9329-4005-af43-321c64c29bf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-32426523-3259-4577-bae9-a30597760c7e req-16cc0a89-d55e-4532-a1bc-80ec8f609e09 service nova] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:57:22 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1ecd6-8554-49c7-bf40-81210e72286d]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG os_brick.utils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:22 user nova-compute[87365]: DEBUG nova.compute.manager [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:57:22 user nova-compute[87365]: INFO nova.compute.manager [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] instance snapshotting
Nov 08 13:57:22 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Beginning live snapshot process
Nov 08 13:57:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.286s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.255s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78.delta 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78.delta 1073741824" returned: 0 in 0.063s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 13:57:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:57:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] COPY block job progress, current cursor: 47644672 final cursor: 75563008 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:57:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 13:57:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 13:57:25 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:57:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78.delta /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78.delta /opt/stack/data/nova/instances/snapshots/tmpjvbjq7sf/4e6fa93d274849379f5a3e0d4157bb78" returned: 0 in 0.834s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Snapshot extracted, beginning image upload
Nov 08 13:57:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Snapshot image upload complete
Nov 08 13:57:29 user nova-compute[87365]: INFO nova.compute.manager [None req-73cee485-d66f-4009-a87d-5606b0295c20 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Took 6.99 seconds to snapshot the instance on the hypervisor.
Nov 08 13:57:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhVfmwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:36 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:36 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:36 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[661518f7-fb56-4418-b241-08428b2b2830]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:57:36 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7e5083-1cb0-4750-a320-0b298b2e30d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7] added
Nov 08 13:57:36 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d4225-4f66-4eec-95c5-53f006df8fda]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[60731dd1-c304-4707-b1f8-3df59d2578ea]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhVfmwiH {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZhVfmwiH" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88cc39-5a94-469c-b53c-b011c351574f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZhVfmwiH'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69c03b-3bf4-4b94-9712-d5ce377994ec]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5d80f-862c-4b48-beda-ea1cda2c099c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:36 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:36 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:36 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:36 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:36 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:36 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa1600c-5c22-467c-b26f-81d3e485d6bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260]
Nov 08 13:57:36 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260] successful.
Nov 08 13:57:36 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc0558-0878-43ee-bac6-2666d92eb9e1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[398eef15-0633-491b-839b-b05a57e04d9b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:37 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de72d3-708c-4e66-b6a9-24e9cdc4f6ce]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhVfmwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:57:37 user nova-compute[87365]: INFO nova.compute.claims [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Claim successful on node user
Nov 08 13:57:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23634613836316333', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613836316333', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:57:38 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:57:38 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 13:57:38 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:57:38 user nova-compute[87365]:   <serial>219e9157-c4db-4d09-8ec3-5a090612d6b7</serial>
Nov 08 13:57:38 user nova-compute[87365]: </disk>
Nov 08 13:57:38 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:38 user nova-compute[87365]: INFO nova.compute.manager [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Terminating instance
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-unplugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] No waiting events found dispatching network-vif-unplugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-474b14ac-431d-4b92-aade-77d92dea58e4 req-a5e504af-d2fb-496d-9bb5-25779434f7e1 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-unplugged-97594d65-a575-4324-a713-6892a8a1a70b for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.060s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No VIF found with MAC fa:16:3e:cf:8c:ec, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:57:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:57:38 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2df6cc1c-091b-46b7-90d8-3afa15e4c71d tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.954s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Instance destroyed successfully.
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'resources' on Instance uuid f01a521f-e959-4924-9d84-930bede41ab1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-268076932',display_name='tempest-ServerRescueNegativeTestJSON-server-268076932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-268076932',id=25,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnj3SAEJU5zWUYfvOMXZ5/A6s6v/2KL7OtTas/9rkpuK3LxvKunsr07YCvVByZsH1cggrYdae+wPjQPDV8Nc3BLpIMWZFI6QCLyWctSsOJ+VjEE8IZ1wK8d5ev+nWlw+g==',key_name='tempest-keypair-1910691992',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-7tef06af',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:52:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74300a84ce074dd38166c961d57071cd',uuid=f01a521f-e959-4924-9d84-930bede41ab1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "97594d65-a575-4324-a713-6892a8a1a70b", "address": "fa:16:3e:54:77:5c", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97594d65-a5", "ovs_interfaceid": "97594d65-a575-4324-a713-6892a8a1a70b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG os_vif [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97594d65-a5, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:57:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Creating image(s)
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "/opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "/opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.policy [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '655ec7640dd941a694935dce487dc084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed3009d663c40e993a1686fc0b7610a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f5e1c31-3332-4819-b2e6-e787fd81e56b) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:39 user nova-compute[87365]: INFO os_vif [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:77:5c,bridge_name='br-int',has_traffic_filtering=True,id=97594d65-a575-4324-a713-6892a8a1a70b,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97594d65-a5')
Nov 08 13:57:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Deleting instance files /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1_del
Nov 08 13:57:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Deletion of /opt/stack/data/nova/instances/f01a521f-e959-4924-9d84-930bede41ab1_del complete
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: INFO nova.compute.manager [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.245s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk 1073741824" returned: 0 in 0.054s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Cannot resize image /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Ensure instance console log exists: /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] Acquiring lock "f01a521f-e959-4924-9d84-930bede41ab1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] Lock "f01a521f-e959-4924-9d84-930bede41ab1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] No waiting events found dispatching network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:40 user nova-compute[87365]: WARNING nova.compute.manager [req-fea40d72-349a-43a0-8136-93614d09a4da req-f713fcfd-41f4-4b87-bc3c-ad67024836af service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received unexpected event network-vif-plugged-97594d65-a575-4324-a713-6892a8a1a70b for instance with vm_state active and task_state deleting.
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:41 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Took 2.14 seconds to deallocate network for instance.
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Successfully created port: c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:42 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Deleted allocations for instance f01a521f-e959-4924-9d84-930bede41ab1
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e86e0fc-4898-471a-8888-cfdbbe5f8e26 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "f01a521f-e959-4924-9d84-930bede41ab1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.222s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:42 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'f01a521f-e959-4924-9d84-930bede41ab1' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f01a521f-e959-4924-9d84-930bede41ab1' (instance-00000019)
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Successfully updated port: c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-5dc126d3-d5b6-4278-8e61-7bbe77dd571f req-c59990c6-45aa-4b9e-bd7b-832b4997da28 service nova] [instance: f01a521f-e959-4924-9d84-930bede41ab1] Received event network-vif-deleted-97594d65-a575-4324-a713-6892a8a1a70b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdAlbaUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:57:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:57:43 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquired lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=24.324039459228516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7dc70-0488-4174-888e-b71a530b3875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:57:43 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd63e8f1-84bc-4bbc-9b85-39b0c3bc92ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694] added
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2926e96-0532-4f14-9cee-913b38348723]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf536df-97c1-4d3c-92aa-a5dd1ae2e33c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdAlbaUO {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdAlbaUO" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[be42dd73-bfa5-433d-b862-dcda1fbac7ff]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WdAlbaUO'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc7713-8d14-4cbc-b2d0-d5aef1da4b6b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Applying migration context for instance de510f72-fe85-4b4f-8938-ca8976aaff02 as it has an incoming, in-progress migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f. Migration status is post-migrating {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 13:57:43 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating resource usage from migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a021de1b-3753-48b6-8541-c30a2597ab72]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27c91c-0bc9-4d92-865a-69b1c04d0623]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260]
Nov 08 13:57:43 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260] successful.
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff54f4b-81b3-47b9-a14b-86141f1973ba]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb134ef-1483-471f-8f32-025191e8286f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:57:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1668d-fbee-46ee-9159-587ef4c7eb3a]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:57:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Releasing lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Instance network_info: |[{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Start _get_guest_xml network_info=[{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:57:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1824025760',display_name='tempest-SnapshotDataIntegrityTests-server-1824025760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1824025760',id=31,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy3EZdlsswVCDE1CgwBq1mJ8h/XumcylYuC/rvOCjCBekultcRhnnCgJ+JcHoQmBK5Pgop1nUjxnGM3tOy6RJ38ndo64ww9D+xAnqxesj8WVIx/WeZjglUtZiHSp3NUrg==',key_name='tempest-keypair-1613074681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed3009d663c40e993a1686fc0b7610a',ramdisk_id='',reservation_id='r-szo0jegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2082748282',owner_user_name='tempest-SnapshotDataIntegrityTests-2082748282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655ec7640dd941a694935dce487dc084',uuid=1f33375d-af45-4ce6-b51d-18cbcf50b723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converting VIF {"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:57:44 user nova-compute[87365]:   <uuid>1f33375d-af45-4ce6-b51d-18cbcf50b723</uuid>
Nov 08 13:57:44 user nova-compute[87365]:   <name>instance-0000001f</name>
Nov 08 13:57:44 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:57:44 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:57:44 user nova-compute[87365]:   <metadata>
Nov 08 13:57:44 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:57:44 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1824025760</nova:name>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:57:44</nova:creationTime>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:57:44 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:57:44 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:owner>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:user uuid="655ec7640dd941a694935dce487dc084">tempest-SnapshotDataIntegrityTests-2082748282-project-member</nova:user>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:project uuid="bed3009d663c40e993a1686fc0b7610a">tempest-SnapshotDataIntegrityTests-2082748282</nova:project>
Nov 08 13:57:44 user nova-compute[87365]:       </nova:owner>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:57:44 user nova-compute[87365]:       <nova:ports>
Nov 08 13:57:44 user nova-compute[87365]:         <nova:port uuid="c605ea5c-72cf-4291-9ffb-eaeb0c449506">
Nov 08 13:57:44 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 13:57:44 user nova-compute[87365]:         </nova:port>
Nov 08 13:57:44 user nova-compute[87365]:       </nova:ports>
Nov 08 13:57:44 user nova-compute[87365]:     </nova:instance>
Nov 08 13:57:44 user nova-compute[87365]:   </metadata>
Nov 08 13:57:44 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:57:44 user nova-compute[87365]:     <system>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="serial">1f33375d-af45-4ce6-b51d-18cbcf50b723</entry>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="uuid">1f33375d-af45-4ce6-b51d-18cbcf50b723</entry>
Nov 08 13:57:44 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:57:44 user nova-compute[87365]:     </system>
Nov 08 13:57:44 user nova-compute[87365]:   </sysinfo>
Nov 08 13:57:44 user nova-compute[87365]:   <os>
Nov 08 13:57:44 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:57:44 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:57:44 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:57:44 user nova-compute[87365]:   </os>
Nov 08 13:57:44 user nova-compute[87365]:   <features>
Nov 08 13:57:44 user nova-compute[87365]:     <acpi/>
Nov 08 13:57:44 user nova-compute[87365]:     <apic/>
Nov 08 13:57:44 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:57:44 user nova-compute[87365]:   </features>
Nov 08 13:57:44 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:57:44 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:57:44 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:57:44 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:57:44 user nova-compute[87365]:   </clock>
Nov 08 13:57:44 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:57:44 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:57:44 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:57:44 user nova-compute[87365]:   </cpu>
Nov 08 13:57:44 user nova-compute[87365]:   <devices>
Nov 08 13:57:44 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:57:44 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:57:44 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk"/>
Nov 08 13:57:44 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:57:44 user nova-compute[87365]:     </disk>
Nov 08 13:57:44 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:57:44 user nova-compute[87365]:       <mac address="fa:16:3e:65:d0:12"/>
Nov 08 13:57:44 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:57:44 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:57:44 user nova-compute[87365]:       <target dev="tapc605ea5c-72"/>
Nov 08 13:57:44 user nova-compute[87365]:     </interface>
Nov 08 13:57:44 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:57:44 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/console.log" append="off"/>
Nov 08 13:57:44 user nova-compute[87365]:     </serial>
Nov 08 13:57:44 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:57:44 user nova-compute[87365]:     <video>
Nov 08 13:57:44 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:57:44 user nova-compute[87365]:     </video>
Nov 08 13:57:44 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:57:44 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:57:44 user nova-compute[87365]:     </rng>
Nov 08 13:57:44 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:57:44 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:57:44 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:57:44 user nova-compute[87365]:     </memballoon>
Nov 08 13:57:44 user nova-compute[87365]:   </devices>
Nov 08 13:57:44 user nova-compute[87365]: </domain>
Nov 08 13:57:44 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1824025760',display_name='tempest-SnapshotDataIntegrityTests-server-1824025760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1824025760',id=31,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy3EZdlsswVCDE1CgwBq1mJ8h/XumcylYuC/rvOCjCBekultcRhnnCgJ+JcHoQmBK5Pgop1nUjxnGM3tOy6RJ38ndo64ww9D+xAnqxesj8WVIx/WeZjglUtZiHSp3NUrg==',key_name='tempest-keypair-1613074681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed3009d663c40e993a1686fc0b7610a',ramdisk_id='',reservation_id='r-szo0jegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2082748282',owner_user_name='tempest-SnapshotDataIntegrityTests-2082748282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655ec7640dd941a694935dce487dc084',uuid=1f33375d-af45-4ce6-b51d-18cbcf50b723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converting VIF {"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG os_vif [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3010d1b9-9ffc-5279-939a-016c4e266f66', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc605ea5c-72, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc605ea5c-72, col_values=(('qos', UUID('16fe0424-ca2f-4bf0-afc3-e63998420f18')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc605ea5c-72, col_values=(('external_ids', {'iface-id': 'c605ea5c-72cf-4291-9ffb-eaeb0c449506', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:d0:12', 'vm-uuid': '1f33375d-af45-4ce6-b51d-18cbcf50b723'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:44 user nova-compute[87365]: INFO os_vif [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72')
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No VIF found with MAC fa:16:3e:65:d0:12, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.898s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdAlbaUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23339623239366438', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339623239366438', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lazy-loading 'flavor' on Instance uuid cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:57:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:57:44 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:57:44 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:57:44 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:57:44 user nova-compute[87365]:   <serial>45131908-6f38-4694-878f-a4793dc23694</serial>
Nov 08 13:57:44 user nova-compute[87365]: </disk>
Nov 08 13:57:44 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-changed-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Refreshing instance network info cache due to event network-changed-c605ea5c-72cf-4291-9ffb-eaeb0c449506. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] Acquiring lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] Acquired lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Refreshing network info cache for port c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updated VIF entry in instance network info cache for port c605ea5c-72cf-4291-9ffb-eaeb0c449506. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-37f718f8-fedb-4ab6-8156-a288c3fe5935 req-16c2aed4-f957-4552-a314-d2c4265dce01 service nova] Releasing lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] No VIF found with MAC fa:16:3e:24:72:b3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-103c838e-510c-4bc8-9bd7-cf417ed2fa3c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.025s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] No waiting events found dispatching network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:47 user nova-compute[87365]: WARNING nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received unexpected event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 for instance with vm_state building and task_state spawning.
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] No waiting events found dispatching network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:57:47 user nova-compute[87365]: WARNING nova.compute.manager [req-ab1cff6d-404e-451c-92d2-f32d7cf492cc req-74aa9889-6e31-4b97-bf3a-0dbd731e9101 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received unexpected event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 for instance with vm_state building and task_state spawning.
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:57:47 user nova-compute[87365]: INFO nova.compute.manager [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Detaching volume 45131908-6f38-4694-878f-a4793dc23694
Nov 08 13:57:47 user nova-compute[87365]: INFO nova.virt.block_device [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Attempting to driver detach volume 45131908-6f38-4694-878f-a4793dc23694 from mountpoint /dev/vdb
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Attempting to detach device vdb from instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:57:47 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:57:47 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:57:47 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:57:47 user nova-compute[87365]:   <serial>45131908-6f38-4694-878f-a4793dc23694</serial>
Nov 08 13:57:47 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:57:47 user nova-compute[87365]: </disk>
Nov 08 13:57:47 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:57:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Successfully detached device vdb from instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 from the persistent domain config.
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:57:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:57:47 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:57:47 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:57:47 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:57:47 user nova-compute[87365]:   <serial>45131908-6f38-4694-878f-a4793dc23694</serial>
Nov 08 13:57:47 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:57:47 user nova-compute[87365]: </disk>
Nov 08 13:57:47 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:57:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Instance spawned successfully.
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:57:48 user nova-compute[87365]: INFO nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Took 9.43 seconds to spawn the instance on the hypervisor.
Nov 08 13:57:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:57:48 user nova-compute[87365]: INFO nova.compute.manager [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Took 10.98 seconds to build instance.
Nov 08 13:57:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64832eaa-72e1-458c-b94b-7693597af43a tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.116s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:57:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:57:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Starting finish_migration {{(pid=87365) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:58:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Creating image(s)
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk. size=21474836480 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk 21474836480 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk 21474836480" returned: 0 in 0.084s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Ensure instance console log exists: /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start _get_guest_xml network_info=[{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'de510f72-fe85-4b4f-8938-ca8976aaff02', 'attached_at': '2023-11-08T13:58:02.000000', 'detached_at': '', 'volume_id': '32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'serial': '32ad28e0-7d1d-4caf-89ff-4b668ed6d91e'}, 'attachment_id': '735b72c3-bfaa-4eaf-9eb4-427f99343184', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:58:02 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:02 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:58:02 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:58:02 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:58:02 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fccf4f-10b7-4855-ad4e-901ae47c5656]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:58:02 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9c112-776a-4baf-9925-3697e90408d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e] added
Nov 08 13:58:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e0c4e-d331-4900-9531-fddce63c4f74]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4b8da-b67b-47de-b8c4-595c023eec85]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKvDyBXG {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EKvDyBXG" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d78fba4-7473-4365-816a-40b6b82aa88d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EKvDyBXG'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f66fe-a1db-4cc1-8416-86c4a01bba5d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb66f17b-23b8-4da8-b1e2-7f17663fd3bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:58:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d822df-99bb-46f0-9ba7-e4483893eb29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]
Nov 08 13:58:03 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.
Nov 08 13:58:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f024c-f931-46df-b624-85e7830faac9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc2e95c-35da-47d2-82ff-dc09adea47d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:03 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9045bec5-c539-4959-a41d-6863a513217d]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:58:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26338326361663365', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338326361663365', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:58:04 user nova-compute[87365]:   <uuid>de510f72-fe85-4b4f-8938-ca8976aaff02</uuid>
Nov 08 13:58:04 user nova-compute[87365]:   <name>instance-00000016</name>
Nov 08 13:58:04 user nova-compute[87365]:   <memory>2097152</memory>
Nov 08 13:58:04 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:58:04 user nova-compute[87365]:   <metadata>
Nov 08 13:58:04 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:58:04 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:name>tempest-ServerActionsTestOtherB-server-1002097682</nova:name>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:58:02</nova:creationTime>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:flavor name="m1.small">
Nov 08 13:58:04 user nova-compute[87365]:         <nova:memory>2048</nova:memory>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:disk>20</nova:disk>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:58:04 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:owner>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:user uuid="056f4860196044679b260c22a8c83f7f">tempest-ServerActionsTestOtherB-1469249614-project-member</nova:user>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:project uuid="cf4f3ebf487840099cd65d5c708fe710">tempest-ServerActionsTestOtherB-1469249614</nova:project>
Nov 08 13:58:04 user nova-compute[87365]:       </nova:owner>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:58:04 user nova-compute[87365]:       <nova:ports>
Nov 08 13:58:04 user nova-compute[87365]:         <nova:port uuid="1becc56c-05fc-4353-9bb9-7ed7ad36cbda">
Nov 08 13:58:04 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 13:58:04 user nova-compute[87365]:         </nova:port>
Nov 08 13:58:04 user nova-compute[87365]:       </nova:ports>
Nov 08 13:58:04 user nova-compute[87365]:     </nova:instance>
Nov 08 13:58:04 user nova-compute[87365]:   </metadata>
Nov 08 13:58:04 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:58:04 user nova-compute[87365]:     <system>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="serial">de510f72-fe85-4b4f-8938-ca8976aaff02</entry>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="uuid">de510f72-fe85-4b4f-8938-ca8976aaff02</entry>
Nov 08 13:58:04 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:58:04 user nova-compute[87365]:     </system>
Nov 08 13:58:04 user nova-compute[87365]:   </sysinfo>
Nov 08 13:58:04 user nova-compute[87365]:   <os>
Nov 08 13:58:04 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:58:04 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:58:04 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:58:04 user nova-compute[87365]:   </os>
Nov 08 13:58:04 user nova-compute[87365]:   <features>
Nov 08 13:58:04 user nova-compute[87365]:     <acpi/>
Nov 08 13:58:04 user nova-compute[87365]:     <apic/>
Nov 08 13:58:04 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:58:04 user nova-compute[87365]:   </features>
Nov 08 13:58:04 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:58:04 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:58:04 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:58:04 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:58:04 user nova-compute[87365]:   </clock>
Nov 08 13:58:04 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:58:04 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:58:04 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:58:04 user nova-compute[87365]:   </cpu>
Nov 08 13:58:04 user nova-compute[87365]:   <devices>
Nov 08 13:58:04 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:58:04 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:58:04 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk"/>
Nov 08 13:58:04 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:58:04 user nova-compute[87365]:     </disk>
Nov 08 13:58:04 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:58:04 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:58:04 user nova-compute[87365]:       <source dev="/dev/sdf"/>
Nov 08 13:58:04 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:58:04 user nova-compute[87365]:       <serial>32ad28e0-7d1d-4caf-89ff-4b668ed6d91e</serial>
Nov 08 13:58:04 user nova-compute[87365]:     </disk>
Nov 08 13:58:04 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:58:04 user nova-compute[87365]:       <mac address="fa:16:3e:2f:76:b0"/>
Nov 08 13:58:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:04 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:58:04 user nova-compute[87365]:       <target dev="tap1becc56c-05"/>
Nov 08 13:58:04 user nova-compute[87365]:     </interface>
Nov 08 13:58:04 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:58:04 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/console.log" append="off"/>
Nov 08 13:58:04 user nova-compute[87365]:     </serial>
Nov 08 13:58:04 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:58:04 user nova-compute[87365]:     <video>
Nov 08 13:58:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:04 user nova-compute[87365]:     </video>
Nov 08 13:58:04 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:58:04 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:58:04 user nova-compute[87365]:     </rng>
Nov 08 13:58:04 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:58:04 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:58:04 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:58:04 user nova-compute[87365]:     </memballoon>
Nov 08 13:58:04 user nova-compute[87365]:   </devices>
Nov 08 13:58:04 user nova-compute[87365]: </domain>
Nov 08 13:58:04 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1495270355-network", "vif_mac": "fa:16:3e:2f:76:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG os_vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '167361b3-fd46-51cc-925d-59496832625e', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1becc56c-05, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1becc56c-05, col_values=(('qos', UUID('2a97b156-6e59-408f-8c27-800b660ba017')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1becc56c-05, col_values=(('external_ids', {'iface-id': '1becc56c-05fc-4353-9bb9-7ed7ad36cbda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:76:b0', 'vm-uuid': 'de510f72-fe85-4b4f-8938-ca8976aaff02'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:04 user nova-compute[87365]: INFO os_vif [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05')
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:58:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] No VIF found with MAC fa:16:3e:2f:76:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:05 user nova-compute[87365]: WARNING nova.compute.manager [req-5c93c2f4-4b64-4c2b-886c-b018d60bdbc4 req-85156e0d-13ff-4115-aa07-5fe14a71d3cb service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_finish.
Nov 08 13:58:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:58:07 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance running successfully.
Nov 08 13:58:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Failed to set time: agent not configured {{(pid=87365) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08d925eb-c984-4965-8107-d8981c738e0a tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] finish_migration finished successfully. {{(pid=87365) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1f6dec05-e26e-4b96-adfc-301949e7e269 req-fb7aba59-b292-4d31-920b-e884072341f5 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state active and task_state resize_finish.
Nov 08 13:58:08 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 is timed out.
Nov 08 13:58:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Successfully detached device vdb from instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 from the live domain config.
Nov 08 13:58:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdAlbaUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:58:08 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da4c11-6072-46fc-9c0c-0719e0b451e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:58:08 user nova-compute[87365]: No targets found.
Nov 08 13:58:08 user nova-compute[87365]: iSNS:
Nov 08 13:58:08 user nova-compute[87365]: No targets found.
Nov 08 13:58:08 user nova-compute[87365]: STATIC:
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e
Nov 08 13:58:08 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:58:08 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:58:08 user nova-compute[87365]: FIRMWARE:
Nov 08 13:58:08 user nova-compute[87365]: No targets found.
Nov 08 13:58:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:58:08 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:58:08 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a550df0e-530e-4f48-adba-17847a04b9a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93c7e09-0786-4db7-a10c-b92734a8465e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 (non-flash)
Nov 08 13:58:08 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf87e6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a9f28-88db-4fd7-9677-318f03cef70c]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ab28eb-f592-4b43-bef7-44337b37b692]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1248cfcd-15f6-4fc6-80f5-5a04d3e68d69]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9874429c-8881-4e0e-82c8-aed314085666]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516df6d-a30e-46a4-8e6a-0128fdb77f97]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ba163-9472-457d-8301-d9ebeaa6dd1e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260]
Nov 08 13:58:08 user nova-compute[87365]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694, portal: 172.16.0.220,3260] successful.
Nov 08 13:58:08 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45131908-6f38-4694-878f-a4793dc23694 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdd1c1-2bbb-4f31-91d0-0985a86b810d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] <== disconnect_volume: return (379ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:58:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:58:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:09 user nova-compute[87365]: DEBUG nova.objects.instance [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lazy-loading 'flavor' on Instance uuid cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70e2664a-a383-4604-870c-bfe4fef83995 tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.069s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:58:19 user nova-compute[87365]: INFO nova.compute.claims [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Claim successful on node user
Nov 08 13:58:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:58:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:58:19 user nova-compute[87365]: DEBUG nova.policy [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:58:19 user nova-compute[87365]: INFO nova.virt.block_device [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Booting with volume snapshot 47746c62-a733-40fe-9119-9704ba4816c6 at /dev/vda
Nov 08 13:58:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Successfully created port: 98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Successfully updated port: 98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-changed-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Refreshing instance network info cache due to event network-changed-98fd8bd5-d8b7-4c32-94d4-775a157eae52. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] Acquiring lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Updating instance_info_cache with network_info: [{"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Instance network_info: |[{"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] Acquired lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Refreshing network info cache for port 98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:58:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Updated VIF entry in instance network info cache for port 98fd8bd5-d8b7-4c32-94d4-775a157eae52. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:58:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Updating instance_info_cache with network_info: [{"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0078f455-e400-4299-82fa-41f340c9fae9 req-c8bbaeac-9cb9-451e-8dce-139dbb1e8cd7 service nova] Releasing lock "refresh_cache-43d8299d-a8c7-4353-87f1-dcc7a2756c94" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:58:28 user nova-compute[87365]: INFO nova.compute.claims [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Claim successful on node user
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.785s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:58:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:58:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.policy [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3e29e071ca349acb9c8f88ff94673f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55494d4d04b9584f2cd125ebe9b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:58:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Creating image(s)
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "/opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "/opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "/opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk 1073741824" returned: 0 in 0.052s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Successfully created port: 047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Cannot resize image /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Ensure instance console log exists: /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Successfully updated port: 047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquired lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing instance network info cache due to event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] Acquiring lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.utils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea503a75-6350-4d3e-88b7-08f3648e14c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[588555b4-56f5-4e2c-be06-33b571fa6abd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0166fa82-203c-4c65-8602-174ea2799301]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd7901f-fcd4-4880-b890-5f1ff1c79581]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:58:30 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec86fc32-d0d7-46a5-b9f4-ac3cc1daf593]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG os_brick.utils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Updating existing volume attachment record: dad9543f-9b4b-48a7-84fa-03477b9fc057 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Releasing lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Instance network_info: |[{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] Acquired lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.network.neutron [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:58:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Start _get_guest_xml network_info=[{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:58:31 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:31 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992839902',display_name='tempest-TestStampPattern-server-1992839902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992839902',id=33,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-af108x8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:58:29Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=41b54c9e-bc8b-4f7b-8203-628370bb251a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.objects.instance [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'pci_devices' on Instance uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:58:31 user nova-compute[87365]:   <uuid>41b54c9e-bc8b-4f7b-8203-628370bb251a</uuid>
Nov 08 13:58:31 user nova-compute[87365]:   <name>instance-00000021</name>
Nov 08 13:58:31 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:58:31 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:58:31 user nova-compute[87365]:   <metadata>
Nov 08 13:58:31 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:58:31 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:name>tempest-TestStampPattern-server-1992839902</nova:name>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:58:31</nova:creationTime>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:58:31 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:58:31 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:owner>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:user uuid="c3e29e071ca349acb9c8f88ff94673f8">tempest-TestStampPattern-135387725-project-member</nova:user>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:project uuid="a5b55494d4d04b9584f2cd125ebe9b67">tempest-TestStampPattern-135387725</nova:project>
Nov 08 13:58:31 user nova-compute[87365]:       </nova:owner>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:58:31 user nova-compute[87365]:       <nova:ports>
Nov 08 13:58:31 user nova-compute[87365]:         <nova:port uuid="047189fa-55f6-4627-81ee-5ef69ce1d0cf">
Nov 08 13:58:31 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 13:58:31 user nova-compute[87365]:         </nova:port>
Nov 08 13:58:31 user nova-compute[87365]:       </nova:ports>
Nov 08 13:58:31 user nova-compute[87365]:     </nova:instance>
Nov 08 13:58:31 user nova-compute[87365]:   </metadata>
Nov 08 13:58:31 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:58:31 user nova-compute[87365]:     <system>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="serial">41b54c9e-bc8b-4f7b-8203-628370bb251a</entry>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="uuid">41b54c9e-bc8b-4f7b-8203-628370bb251a</entry>
Nov 08 13:58:31 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:58:31 user nova-compute[87365]:     </system>
Nov 08 13:58:31 user nova-compute[87365]:   </sysinfo>
Nov 08 13:58:31 user nova-compute[87365]:   <os>
Nov 08 13:58:31 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:58:31 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:58:31 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:58:31 user nova-compute[87365]:   </os>
Nov 08 13:58:31 user nova-compute[87365]:   <features>
Nov 08 13:58:31 user nova-compute[87365]:     <acpi/>
Nov 08 13:58:31 user nova-compute[87365]:     <apic/>
Nov 08 13:58:31 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:58:31 user nova-compute[87365]:   </features>
Nov 08 13:58:31 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:58:31 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:58:31 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:58:31 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:58:31 user nova-compute[87365]:   </clock>
Nov 08 13:58:31 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:58:31 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:58:31 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:58:31 user nova-compute[87365]:   </cpu>
Nov 08 13:58:31 user nova-compute[87365]:   <devices>
Nov 08 13:58:31 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:58:31 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:58:31 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk"/>
Nov 08 13:58:31 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:58:31 user nova-compute[87365]:     </disk>
Nov 08 13:58:31 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:58:31 user nova-compute[87365]:       <mac address="fa:16:3e:4d:05:52"/>
Nov 08 13:58:31 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:31 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:58:31 user nova-compute[87365]:       <target dev="tap047189fa-55"/>
Nov 08 13:58:31 user nova-compute[87365]:     </interface>
Nov 08 13:58:31 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:58:31 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/console.log" append="off"/>
Nov 08 13:58:31 user nova-compute[87365]:     </serial>
Nov 08 13:58:31 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:58:31 user nova-compute[87365]:     <video>
Nov 08 13:58:31 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:31 user nova-compute[87365]:     </video>
Nov 08 13:58:31 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:58:31 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:58:31 user nova-compute[87365]:     </rng>
Nov 08 13:58:31 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:58:31 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:58:31 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:58:31 user nova-compute[87365]:     </memballoon>
Nov 08 13:58:31 user nova-compute[87365]:   </devices>
Nov 08 13:58:31 user nova-compute[87365]: </domain>
Nov 08 13:58:31 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992839902',display_name='tempest-TestStampPattern-server-1992839902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992839902',id=33,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-af108x8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:58:29Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=41b54c9e-bc8b-4f7b-8203-628370bb251a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG os_vif [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b195a0d-5217-5ef8-ac33-9e7942360aa0', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap047189fa-55, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap047189fa-55, col_values=(('qos', UUID('ab9bfa80-f83b-4a71-9a22-d5a8d7a071b3')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap047189fa-55, col_values=(('external_ids', {'iface-id': '047189fa-55f6-4627-81ee-5ef69ce1d0cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:05:52', 'vm-uuid': '41b54c9e-bc8b-4f7b-8203-628370bb251a'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:31 user nova-compute[87365]: INFO os_vif [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55')
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No VIF found with MAC fa:16:3e:4d:05:52, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.neutron [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updated VIF entry in instance network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG nova.network.neutron [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fbb03496-62b2-4d98-8121-50dc738a9cf3 req-d6cad7d0-56f2-4d21-b7b3-56365daba140 service nova] Releasing lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:32 user nova-compute[87365]: WARNING nova.compute.manager [req-7476ada0-47c7-492a-8c9b-8b8880d9712c req-b93c30d1-e847-41f1-8268-b57596799bea service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state building and task_state spawning.
Nov 08 13:58:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:33 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:58:34 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Instance spawned successfully.
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:58:34 user nova-compute[87365]: INFO nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:34 user nova-compute[87365]: WARNING nova.compute.manager [req-8e954a57-c1f3-409d-a581-ba4298bc804a req-5c44d781-3d02-4069-b239-56feb45ff66d service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state building and task_state spawning.
Nov 08 13:58:34 user nova-compute[87365]: INFO nova.compute.manager [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Took 6.97 seconds to build instance.
Nov 08 13:58:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-599de004-2345-4237-a900-1307c0cb8c2b tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.078s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:58:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:39 user nova-compute[87365]: INFO nova.compute.manager [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Rescuing
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating instance_info_cache with network_info: [{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:40 user nova-compute[87365]: WARNING nova.compute.manager [req-df749a8e-a08d-491c-abef-c1425d256c4f req-71b97d98-198d-4c83-8787-352f9d1fd70c service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state rescuing.
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance destroyed successfully.
Nov 08 13:58:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Attempting a stable device rescue
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=87365) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:58:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Creating image(s)
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:42 user nova-compute[87365]: WARNING nova.compute.manager [req-552a5258-1241-4d43-ba57-e3e113540680 req-47322ec4-62f5-4360-afdf-1c91df1e97ab service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state rescuing.
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.part --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG nova.virt.images [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] 1362090d-fa7b-40df-8e64-c0eff67e9793 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.part /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.355s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.part /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.converted" returned: 0 in 0.657s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.222s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b --force-share --output=json" returned: 0 in 0.246s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b,backing_fmt=raw /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b,backing_fmt=raw /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue" returned: 0 in 0.071s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "dfa14c1a4992c5d882b44f6ca078cea413ad7b3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'migration_context' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG nova.objects.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<3c7723ce-8e93-40d9-94f8-35767b220322> lazy-loaded attributes: trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start _get_guest_xml network_info=[{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:04:e8:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1362090d-fa7b-40df-8e64-c0eff67e9793', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3c7723ce-8e93-40d9-94f8-35767b220322', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'serial': 'ef23e653-42db-4a4a-9c18-4e5766cc4b2e'}, 'attachment_id': 'bdaf05bc-5d8a-43bb-ac66-66cf63d9cef4', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:58:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<3c7723ce-8e93-40d9-94f8-35767b220322> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<3c7723ce-8e93-40d9-94f8-35767b220322> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:58:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<3c7723ce-8e93-40d9-94f8-35767b220322> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:58:44 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:58:44 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:58:44 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2d0f3-2563-4ba7-9e8c-33b3f1da2906]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jfNIzJPb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 13:58:44 user nova-compute[87365]: node.name = iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:58:44 user nova-compute[87365]: node.tpgt = -1
Nov 08 13:58:44 user nova-compute[87365]: node.startup = automatic
Nov 08 13:58:44 user nova-compute[87365]: node.leading_login = No
Nov 08 13:58:44 user nova-compute[87365]: iface.iscsi_ifacename = default
Nov 08 13:58:44 user nova-compute[87365]: iface.net_ifacename = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.ipaddress = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.prefix_len = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.hwaddress = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.transport_name = tcp
Nov 08 13:58:44 user nova-compute[87365]: iface.initiatorname = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.vlan_id = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.vlan_priority = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.vlan_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.iface_num = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.mtu = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.port = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.bootproto = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.subnet_mask = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.gateway = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_alt_client_id = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_dns = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_learn_iqn = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_vendor_id_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_vendor_id = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.dhcp_slp_da = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.fragmentation = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.gratuitous_arp = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.incoming_forwarding = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.tos_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.tos = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.ttl = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.delayed_ack = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.tcp_nagle = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.tcp_wsf_state = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.tcp_wsf = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.tcp_timer_scale = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.tcp_timestamp = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.redirect = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.def_task_mgmt_timeout = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.header_digest = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.data_digest = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.immediate_data = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.initial_r2t = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.data_seq_inorder = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.data_pdu_inorder = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.erl = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.max_receive_data_len = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.first_burst_len = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.max_outstanding_r2t = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.max_burst_len = 0
Nov 08 13:58:44 user nova-compute[87365]: iface.chap_auth = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.bidi_chap = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.strict_login_compliance = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.discovery_auth = <empty>
Nov 08 13:58:44 user nova-compute[87365]: iface.discovery_logout = <empty>
Nov 08 13:58:44 user nova-compute[87365]: node.discovery_address = <empty>
Nov 08 13:58:44 user nova-compute[87365]: node.discovery_port = 0
Nov 08 13:58:44 user nova-compute[87365]: node.discovery_type = static
Nov 08 13:58:44 user nova-compute[87365]: node.session.initial_cmdsn = 0
Nov 08 13:58:44 user nova-compute[87365]: node.session.initial_login_retry_max = 8
Nov 08 13:58:44 user nova-compute[87365]: node.session.xmit_thread_priority = -20
Nov 08 13:58:44 user nova-compute[87365]: node.session.cmds_max = 128
Nov 08 13:58:44 user nova-compute[87365]: node.session.queue_depth = 32
Nov 08 13:58:44 user nova-compute[87365]: node.session.nr_sessions = 1
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.authmethod = CHAP
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.username = jfNIzJPb
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.password = ***
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.username_in = <empty>
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.password_in = <empty>
Nov 08 13:58:44 user nova-compute[87365]: node.session.auth.chap_algs = MD5
Nov 08 13:58:44 user nova-compute[87365]: node.session.timeo.replacement_timeout = 120
Nov 08 13:58:44 user nova-compute[87365]: node.session.err_timeo.abort_timeout = 15
Nov 08 13:58:44 user nova-compute[87365]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 13:58:44 user nova-compute[87365]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 13:58:44 user nova-compute[87365]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.FastAbort = Yes
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.InitialR2T = No
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.ImmediateData = Yes
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.MaxConnections = 1
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 13:58:44 user nova-compute[87365]: node.session.iscsi.ERL = 0
Nov 08 13:58:44 user nova-compute[87365]: node.session.scan = manual
Nov 08 13:58:44 user nova-compute[87365]: node.session.reopen_max = 0
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].address = 172.16.0.220
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].port = 3260
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].startup = manual
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].tcp.window_size = 524288
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].tcp.type_of_service = 0
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].timeo.logout_timeout = 15
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].timeo.login_timeout = 15
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].timeo.auth_timeout = 45
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.DataDigest = None
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.IFMarker = No
Nov 08 13:58:44 user nova-compute[87365]: node.conn[0].iscsi.OFMarker = No
Nov 08 13:58:44 user nova-compute[87365]: # END RECORD
Nov 08 13:58:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[55557da4-12c6-4609-b233-4651a8061e1b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebedb519-e68a-44ea-9283-da1a145dee1d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfNIzJPb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfNIzJPb" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa8218-00cb-4f47-bdca-7c2647a115d6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfNIzJPb'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f0f7d-a86b-4ae6-be91-007a63e7d1c7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347855c-90c0-440f-9d95-bc7bbce82b5b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:58:44 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:58:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] HCTL ('33', '0', '0', 0) found on session 22 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[15133ef8-d92d-485c-981c-5e787c618184]: (4, ('0 0 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Searching for a device in session 22 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.321s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== connect_volume: return (323ms) {'type': 'block', 'scsi_wwn': '23066346331646433', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066346331646433', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1675383101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1675383101',id=30,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:56:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-s5nxjo0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:56:49Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=3c7723ce-8e93-40d9-94f8-35767b220322,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:04:e8:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "vif_mac": "fa:16:3e:04:e8:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.objects.base [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Object Instance<3c7723ce-8e93-40d9-94f8-35767b220322> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:58:44 user nova-compute[87365]:   <uuid>3c7723ce-8e93-40d9-94f8-35767b220322</uuid>
Nov 08 13:58:44 user nova-compute[87365]:   <name>instance-0000001e</name>
Nov 08 13:58:44 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:58:44 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:58:44 user nova-compute[87365]:   <metadata>
Nov 08 13:58:44 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:58:44 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1675383101</nova:name>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:58:44</nova:creationTime>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:58:44 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:58:44 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:owner>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:user uuid="99bfb420b98c45d9b13589c4b2153fed">tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member</nova:user>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:project uuid="7f67a8efbc924527972b7f3a4fdac0cf">tempest-ServerBootFromVolumeStableRescueTest-1624221445</nova:project>
Nov 08 13:58:44 user nova-compute[87365]:       </nova:owner>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:58:44 user nova-compute[87365]:       <nova:ports>
Nov 08 13:58:44 user nova-compute[87365]:         <nova:port uuid="efd44520-0a16-40c2-b155-409224cec32f">
Nov 08 13:58:44 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 13:58:44 user nova-compute[87365]:         </nova:port>
Nov 08 13:58:44 user nova-compute[87365]:       </nova:ports>
Nov 08 13:58:44 user nova-compute[87365]:     </nova:instance>
Nov 08 13:58:44 user nova-compute[87365]:   </metadata>
Nov 08 13:58:44 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:58:44 user nova-compute[87365]:     <system>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="serial">3c7723ce-8e93-40d9-94f8-35767b220322</entry>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="uuid">3c7723ce-8e93-40d9-94f8-35767b220322</entry>
Nov 08 13:58:44 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:58:44 user nova-compute[87365]:     </system>
Nov 08 13:58:44 user nova-compute[87365]:   </sysinfo>
Nov 08 13:58:44 user nova-compute[87365]:   <os>
Nov 08 13:58:44 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:58:44 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:58:44 user nova-compute[87365]:   </os>
Nov 08 13:58:44 user nova-compute[87365]:   <features>
Nov 08 13:58:44 user nova-compute[87365]:     <acpi/>
Nov 08 13:58:44 user nova-compute[87365]:     <apic/>
Nov 08 13:58:44 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:58:44 user nova-compute[87365]:   </features>
Nov 08 13:58:44 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:58:44 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:58:44 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:58:44 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:58:44 user nova-compute[87365]:   </clock>
Nov 08 13:58:44 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:58:44 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:58:44 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:58:44 user nova-compute[87365]:   </cpu>
Nov 08 13:58:44 user nova-compute[87365]:   <devices>
Nov 08 13:58:44 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:58:44 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:58:44 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 13:58:44 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:58:44 user nova-compute[87365]:       <serial>ef23e653-42db-4a4a-9c18-4e5766cc4b2e</serial>
Nov 08 13:58:44 user nova-compute[87365]:     </disk>
Nov 08 13:58:44 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:58:44 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:58:44 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue"/>
Nov 08 13:58:44 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:58:44 user nova-compute[87365]:       <boot order="1"/>
Nov 08 13:58:44 user nova-compute[87365]:     </disk>
Nov 08 13:58:44 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:58:44 user nova-compute[87365]:       <mac address="fa:16:3e:04:e8:0d"/>
Nov 08 13:58:44 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:44 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:58:44 user nova-compute[87365]:       <target dev="tapefd44520-0a"/>
Nov 08 13:58:44 user nova-compute[87365]:     </interface>
Nov 08 13:58:44 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:58:44 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/console.log" append="off"/>
Nov 08 13:58:44 user nova-compute[87365]:     </serial>
Nov 08 13:58:44 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:58:44 user nova-compute[87365]:     <video>
Nov 08 13:58:44 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:58:44 user nova-compute[87365]:     </video>
Nov 08 13:58:44 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:58:44 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:58:44 user nova-compute[87365]:     </rng>
Nov 08 13:58:44 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:58:44 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:58:44 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:58:44 user nova-compute[87365]:     </memballoon>
Nov 08 13:58:44 user nova-compute[87365]:   </devices>
Nov 08 13:58:44 user nova-compute[87365]: </domain>
Nov 08 13:58:44 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:58:44 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance destroyed successfully.
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] No VIF found with MAC fa:16:3e:04:e8:0d, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:58:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:49 user nova-compute[87365]: WARNING nova.compute.manager [req-2bc41270-4d3e-4019-ba4a-7b7da5d4d276 req-306d555e-51c6-4eee-a290-ee91359eef38 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state rescuing.
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:49 user nova-compute[87365]: WARNING nova.compute.manager [req-75d33203-4fac-4874-a399-ee9491e66792 req-f2be5fc1-b928-4e1d-adcd-f698b0c813f4 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state rescuing.
Nov 08 13:58:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2e05bdf2-8cad-49d2-ba98-852f43c585bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:58:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7041MB free_disk=24.315261840820312GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Applying migration context for instance de510f72-fe85-4b4f-8938-ca8976aaff02 as it has an incoming, in-progress migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f. Migration status is finished {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 13:58:49 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating resource usage from migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 43d8299d-a8c7-4353-87f1-dcc7a2756c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:49 user nova-compute[87365]: INFO nova.compute.manager [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Detaching volume 4ffd2195-3e78-4361-8ee0-440ecd321077
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:58:49 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:58:49 user nova-compute[87365]: INFO nova.virt.block_device [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Attempting to driver detach volume 4ffd2195-3e78-4361-8ee0-440ecd321077 from mountpoint /dev/vdc
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Attempting to detach device vdc from instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:58:50 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:58:50 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:58:50 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 13:58:50 user nova-compute[87365]:   <serial>4ffd2195-3e78-4361-8ee0-440ecd321077</serial>
Nov 08 13:58:50 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 13:58:50 user nova-compute[87365]: </disk>
Nov 08 13:58:50 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:58:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully detached device vdc from instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 from the persistent domain config.
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:58:50 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:58:50 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 13:58:50 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 13:58:50 user nova-compute[87365]:   <serial>4ffd2195-3e78-4361-8ee0-440ecd321077</serial>
Nov 08 13:58:50 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 13:58:50 user nova-compute[87365]: </disk>
Nov 08 13:58:50 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:58:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.967s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Skipping network cache update for instance because it is Building. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:51 user nova-compute[87365]: INFO nova.compute.manager [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Terminating instance
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-unplugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] No waiting events found dispatching network-vif-unplugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-0f1a4581-b803-4120-bf15-adb255c01a5a req-06397672-c5ec-48bf-b6e0-521e7e2b3f9f service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-unplugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Instance destroyed successfully.
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.objects.instance [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lazy-loading 'resources' on Instance uuid cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-345712907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3457129',id=27,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHUJdLZNKkpJgxeSNbIn6T7Vut/my/dqxNFtZn2uaixPNfBFlKsfatl08XlJpijijQC6JHqFwX7wEHg0sjryrLmwoFR/4zKgT6KRv0tHL1nH/KyYavXUgkaV9kvoGkfmA==',key_name='tempest-keypair-1515098170',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17e9fa0d537402287340da296ca1abd',ramdisk_id='',reservation_id='r-p4iod6l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf81297c449d469ea534bf463bffebb2',uuid=cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converting VIF {"id": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "address": "fa:16:3e:24:72:b3", "network": {"id": "5a66c2c1-ae15-48fd-97a7-07119d4aff48", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1938794114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17e9fa0d537402287340da296ca1abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap837405a3-f0", "ovs_interfaceid": "837405a3-f0d7-4ef9-9e76-5350eb7e89ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG os_vif [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [{"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap837405a3-f0, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=157f53bd-53a6-4bb6-bb2b-f6385ebd7107) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:52 user nova-compute[87365]: INFO os_vif [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:b3,bridge_name='br-int',has_traffic_filtering=True,id=837405a3-f0d7-4ef9-9e76-5350eb7e89ec,network=Network(5a66c2c1-ae15-48fd-97a7-07119d4aff48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap837405a3-f0')
Nov 08 13:58:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Deleting instance files /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176_del
Nov 08 13:58:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Deletion of /opt/stack/data/nova/instances/cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176_del complete
Nov 08 13:58:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-02327cf5-f6ca-41c9-983c-f74508ef6b46" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:58:52 user nova-compute[87365]: INFO nova.compute.manager [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 13:58:52 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:58:52 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:53 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Took 0.96 seconds to deallocate network for instance.
Nov 08 13:58:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] Acquiring lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] No waiting events found dispatching network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:53 user nova-compute[87365]: WARNING nova.compute.manager [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received unexpected event network-vif-plugged-837405a3-f0d7-4ef9-9e76-5350eb7e89ec for instance with vm_state deleted and task_state None.
Nov 08 13:58:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-bece0b4d-7c0c-432b-93f2-699af83770f6 req-4f37a795-b80c-4c13-96dd-a8e20d7ffc4b service nova] [instance: cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176] Received event network-vif-deleted-837405a3-f0d7-4ef9-9e76-5350eb7e89ec {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.707s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:54 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Deleted allocations for instance cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:54 user nova-compute[87365]: INFO nova.compute.manager [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Terminating instance
Nov 08 13:58:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-02feaf5e-9ada-4592-b4e8-b506c899173c tempest-TestServerVolumeAttachScenarioOldVersion-532519605 tempest-TestServerVolumeAttachScenarioOldVersion-532519605-project-member] Lock "cc0ce592-5a9a-4e7d-a4fa-f98d71a0f176" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.895s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-a0b9f4f8-350e-425a-aea4-efe7f6b32dfe req-5fc61946-e446-4404-9721-8d0e8b5eef17 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-unplugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Instance destroyed successfully.
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.objects.instance [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'resources' on Instance uuid 8ae2c4a4-aff6-4be8-be12-9e1df495c20e {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-421730953',display_name='tempest-ServerRescueNegativeTestJSON-server-421730953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-421730953',id=5,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-0bezjqai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:45:31Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=8ae2c4a4-aff6-4be8-be12-9e1df495c20e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "60b8cbb7-f771-411b-9de9-effae55c61fe", "address": "fa:16:3e:c9:56:f3", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b8cbb7-f7", "ovs_interfaceid": "60b8cbb7-f771-411b-9de9-effae55c61fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG os_vif [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b8cbb7-f7, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08bc2a1f-8ec0-4a30-9bf9-34864b35ab1b) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:58:55 user nova-compute[87365]: INFO os_vif [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:56:f3,bridge_name='br-int',has_traffic_filtering=True,id=60b8cbb7-f771-411b-9de9-effae55c61fe,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60b8cbb7-f7')
Nov 08 13:58:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Deleting instance files /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e_del
Nov 08 13:58:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Deletion of /opt/stack/data/nova/instances/8ae2c4a4-aff6-4be8-be12-9e1df495c20e_del complete
Nov 08 13:58:55 user nova-compute[87365]: INFO nova.compute.manager [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 08 13:58:55 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:58:55 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Took 0.64 seconds to deallocate network for instance.
Nov 08 13:58:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-81379179-0d4d-425d-8857-af7e632cd1c7 req-efe33ca4-3599-450b-995d-5ab108ac6b1e service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-deleted-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:58:56 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Deleted allocations for instance 8ae2c4a4-aff6-4be8-be12-9e1df495c20e
Nov 08 13:58:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-06f1a985-eeb3-4a44-b423-841551add516 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.529s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] Acquiring lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] Lock "8ae2c4a4-aff6-4be8-be12-9e1df495c20e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:58:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] No waiting events found dispatching network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:58:56 user nova-compute[87365]: WARNING nova.compute.manager [req-90cae527-7415-4d31-b883-f84ffb8248c1 req-168bd807-d2fc-4062-9dba-56c85278f3b0 service nova] [instance: 8ae2c4a4-aff6-4be8-be12-9e1df495c20e] Received unexpected event network-vif-plugged-60b8cbb7-f771-411b-9de9-effae55c61fe for instance with vm_state deleted and task_state None.
Nov 08 13:59:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:10 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 is timed out.
Nov 08 13:59:10 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully detached device vdc from instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 from the live domain config.
Nov 08 13:59:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkAjsLMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:10 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d474da51-bbad-41f9-9998-fb05d7c4b05c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:59:10 user nova-compute[87365]: No targets found.
Nov 08 13:59:10 user nova-compute[87365]: iSNS:
Nov 08 13:59:10 user nova-compute[87365]: No targets found.
Nov 08 13:59:10 user nova-compute[87365]: STATIC:
Nov 08 13:59:10 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7
Nov 08 13:59:10 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:10 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:10 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:59:10 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:10 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:10 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:59:10 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:10 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:10 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077
Nov 08 13:59:10 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:10 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:10 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e
Nov 08 13:59:10 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:10 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:10 user nova-compute[87365]: FIRMWARE:
Nov 08 13:59:10 user nova-compute[87365]: No targets found.
Nov 08 13:59:10 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:59:10 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:59:10 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aced3a-8472-42e8-84e0-5f870fdcd024]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d56c3-3fa8-47e7-9d12-b0e0e458f635]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:10 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:10 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a17829-9d82-454e-8091-fcda30de332f]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e21bfb3-b6af-4cb1-b020-668ef8de2b1f]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccbd838-5415-4334-85c4-7cc7acde13bc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[386b3e9c-20d0-47a4-ab89-aad30d066b0e]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[86833365-674c-4adb-a811-fa62edb8b991]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e887f7-218e-4709-b519-d335e21122b6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260]
Nov 08 13:59:10 user nova-compute[87365]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077, portal: 172.16.0.220,3260] successful.
Nov 08 13:59:10 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ffd2195-3e78-4361-8ee0-440ecd321077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda3ecd-d55d-4b3b-990c-21003c647135]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] <== disconnect_volume: return (292ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:59:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:11 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'flavor' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f089c156-568c-4a1a-865d-0a6578f02c38 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'flavor' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:14 user nova-compute[87365]: INFO nova.compute.manager [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attaching volume 18e622e5-001b-4bfe-b75d-b95b12720630 to /dev/vdb
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.utils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e2aa59-8a41-41a6-9ce9-bb7ecee0f345]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[21051ad3-d0eb-473a-b92d-b2c19c50ea80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6323695-1c0a-46ba-a3e0-d019424f2b5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b35ee1-0755-4275-be7d-4fdef97c799f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:14 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:59:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0c3fdf-8df1-489e-af28-0e0a13ab68ff]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG os_brick.utils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:14 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating existing volume attachment record: 5c29309a-4493-4e57-b98f-0d78aaf4d473 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:59:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:59:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Creating image(s)
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Ensure instance console log exists: /opt/stack/data/nova/instances/43d8299d-a8c7-4353-87f1-dcc7a2756c94/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Start _get_guest_xml network_info=[{"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZxhyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43d8299d-a8c7-4353-87f1-dcc7a2756c94', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2bb34ec-d62a-45be-974a-0eca07be774f', 'serial': 'd2bb34ec-d62a-45be-974a-0eca07be774f'}, 'attachment_id': 'dad9543f-9b4b-48a7-84fa-03477b9fc057', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:59:27 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:27 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZxhyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:27 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:27 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:27 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e961a5-fdb6-454a-8a39-65116c8f1c19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:59:27 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4bf58-f8c4-45fd-88af-386804c563fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f] added
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70aeb25-80b6-47d0-a170-a9fc425b2fbe]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9311be2-af89-4f26-a27b-330ddaed35a0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQZxhyVT {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQZxhyVT" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9790b6f1-958a-47c6-8ef8-2b36e559816f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQZxhyVT'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d2d9dc-1035-4824-bfd3-7f066bfd1e6b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec48c844-618c-4455-b00a-47acd2a0baaa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1582bb4f-2027-484c-8655-e72d3044a056]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260]
Nov 08 13:59:27 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260] successful.
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c1b184-9967-4175-a742-a693f57a5874]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98290e94-7a3a-4347-bcb5-3caa0e0b940c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:27 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26338dd0-533d-4b9f-aa63-8523a88981c8]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:27 user nova-compute[87365]: INFO nova.compute.manager [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Detaching volume 219e9157-c4db-4d09-8ec3-5a090612d6b7
Nov 08 13:59:27 user nova-compute[87365]: INFO nova.virt.block_device [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Attempting to driver detach volume 219e9157-c4db-4d09-8ec3-5a090612d6b7 from mountpoint /dev/vdb
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Attempting to detach device vdb from instance 3a515a52-3292-44f6-812c-e9fed69c8c98 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:59:27 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:59:27 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 13:59:27 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:59:27 user nova-compute[87365]:   <serial>219e9157-c4db-4d09-8ec3-5a090612d6b7</serial>
Nov 08 13:59:27 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:59:27 user nova-compute[87365]: </disk>
Nov 08 13:59:27 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:59:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully detached device vdb from instance 3a515a52-3292-44f6-812c-e9fed69c8c98 from the persistent domain config.
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a515a52-3292-44f6-812c-e9fed69c8c98 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:59:27 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:59:27 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 13:59:27 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:59:27 user nova-compute[87365]:   <serial>219e9157-c4db-4d09-8ec3-5a090612d6b7</serial>
Nov 08 13:59:27 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:59:27 user nova-compute[87365]: </disk>
Nov 08 13:59:27 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:59:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-changed-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Refreshing instance network info cache due to event network-changed-c605ea5c-72cf-4291-9ffb-eaeb0c449506. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] Acquiring lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] Acquired lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Refreshing network info cache for port c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZxhyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23734373463656662', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734373463656662', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147692656',display_name='tempest-TestVolumeBootPattern-server-1147692656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147692656',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-mppil8pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:58:20Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=43d8299d-a8c7-4353-87f1-dcc7a2756c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid 43d8299d-a8c7-4353-87f1-dcc7a2756c94 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:59:28 user nova-compute[87365]:   <uuid>43d8299d-a8c7-4353-87f1-dcc7a2756c94</uuid>
Nov 08 13:59:28 user nova-compute[87365]:   <name>instance-00000020</name>
Nov 08 13:59:28 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:59:28 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:59:28 user nova-compute[87365]:   <metadata>
Nov 08 13:59:28 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:59:28 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:59:28 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-server-1147692656</nova:name>
Nov 08 13:59:28 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:59:27</nova:creationTime>
Nov 08 13:59:28 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:59:28 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:59:28 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:59:28 user nova-compute[87365]:       <nova:owner>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 13:59:28 user nova-compute[87365]:       </nova:owner>
Nov 08 13:59:28 user nova-compute[87365]:       <nova:ports>
Nov 08 13:59:28 user nova-compute[87365]:         <nova:port uuid="98fd8bd5-d8b7-4c32-94d4-775a157eae52">
Nov 08 13:59:28 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 13:59:28 user nova-compute[87365]:         </nova:port>
Nov 08 13:59:28 user nova-compute[87365]:       </nova:ports>
Nov 08 13:59:28 user nova-compute[87365]:     </nova:instance>
Nov 08 13:59:28 user nova-compute[87365]:   </metadata>
Nov 08 13:59:28 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:59:28 user nova-compute[87365]:     <system>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="serial">43d8299d-a8c7-4353-87f1-dcc7a2756c94</entry>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="uuid">43d8299d-a8c7-4353-87f1-dcc7a2756c94</entry>
Nov 08 13:59:28 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:59:28 user nova-compute[87365]:     </system>
Nov 08 13:59:28 user nova-compute[87365]:   </sysinfo>
Nov 08 13:59:28 user nova-compute[87365]:   <os>
Nov 08 13:59:28 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:59:28 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 13:59:28 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:59:28 user nova-compute[87365]:   </os>
Nov 08 13:59:28 user nova-compute[87365]:   <features>
Nov 08 13:59:28 user nova-compute[87365]:     <acpi/>
Nov 08 13:59:28 user nova-compute[87365]:     <apic/>
Nov 08 13:59:28 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:59:28 user nova-compute[87365]:   </features>
Nov 08 13:59:28 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:59:28 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:59:28 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:59:28 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:59:28 user nova-compute[87365]:   </clock>
Nov 08 13:59:28 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:59:28 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:59:28 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:59:28 user nova-compute[87365]:   </cpu>
Nov 08 13:59:28 user nova-compute[87365]:   <devices>
Nov 08 13:59:28 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:59:28 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:59:28 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 13:59:28 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:59:28 user nova-compute[87365]:       <serial>d2bb34ec-d62a-45be-974a-0eca07be774f</serial>
Nov 08 13:59:28 user nova-compute[87365]:     </disk>
Nov 08 13:59:28 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:59:28 user nova-compute[87365]:       <mac address="fa:16:3e:3b:27:9b"/>
Nov 08 13:59:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:59:28 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:59:28 user nova-compute[87365]:       <target dev="tap98fd8bd5-d8"/>
Nov 08 13:59:28 user nova-compute[87365]:     </interface>
Nov 08 13:59:28 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:59:28 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/43d8299d-a8c7-4353-87f1-dcc7a2756c94/console.log" append="off"/>
Nov 08 13:59:28 user nova-compute[87365]:     </serial>
Nov 08 13:59:28 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:59:28 user nova-compute[87365]:     <video>
Nov 08 13:59:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:59:28 user nova-compute[87365]:     </video>
Nov 08 13:59:28 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:59:28 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:59:28 user nova-compute[87365]:     </rng>
Nov 08 13:59:28 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:59:28 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:59:28 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:59:28 user nova-compute[87365]:     </memballoon>
Nov 08 13:59:28 user nova-compute[87365]:   </devices>
Nov 08 13:59:28 user nova-compute[87365]: </domain>
Nov 08 13:59:28 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147692656',display_name='tempest-TestVolumeBootPattern-server-1147692656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147692656',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-mppil8pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:58:20Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=43d8299d-a8c7-4353-87f1-dcc7a2756c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG os_vif [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0084aae7-be58-5f7d-8c92-5fe8e51a57f6', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98fd8bd5-d8, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98fd8bd5-d8, col_values=(('qos', UUID('56084a79-8ad1-4742-b9df-4a32299260b9')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98fd8bd5-d8, col_values=(('external_ids', {'iface-id': '98fd8bd5-d8b7-4c32-94d4-775a157eae52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:27:9b', 'vm-uuid': '43d8299d-a8c7-4353-87f1-dcc7a2756c94'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:28 user nova-compute[87365]: INFO os_vif [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8')
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:3b:27:9b, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updated VIF entry in instance network info cache for port c605ea5c-72cf-4291-9ffb-eaeb0c449506. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0c75829e-758a-4e2b-a239-078e9ec9eb2a req-3c088455-ffe1-4540-813b-2712a3d3b22a service nova] Releasing lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] No waiting events found dispatching network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:30 user nova-compute[87365]: WARNING nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received unexpected event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 for instance with vm_state building and task_state spawning.
Nov 08 13:59:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] No waiting events found dispatching network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:30 user nova-compute[87365]: WARNING nova.compute.manager [req-fa43c732-aee8-499f-9ba6-35635120939d req-3ad1e8dd-696b-401d-ad1d-73a70f7cd10f service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received unexpected event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 for instance with vm_state building and task_state spawning.
Nov 08 13:59:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:59:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Instance spawned successfully.
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:59:32 user nova-compute[87365]: INFO nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 08 13:59:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:59:32 user nova-compute[87365]: INFO nova.compute.manager [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Took 73.36 seconds to build instance.
Nov 08 13:59:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-eaa426b8-14ca-4783-9a2a-2a656233a736 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.482s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG nova.objects.instance [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:35 user nova-compute[87365]: INFO nova.compute.manager [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attaching volume 819974d7-9e91-48b4-b2b2-12c5f7af83f6 to /dev/vdb
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.utils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b1bec-cd89-465d-a44a-fdf8de6471ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f7c8a2-c5ca-4c2f-a76e-be367a20efed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12f4611-7ff5-4d30-837a-67c2056db009]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ded249a-0d2a-4b03-a488-f12d1a46186e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:35 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:59:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b6dbd3-16e4-420c-b943-ab2ab7795f32]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG os_brick.utils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:35 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating existing volume attachment record: 98352baa-c8f7-47cc-ab68-2987fe27f364 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:38 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:38 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:38 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6543adc-dd81-4da6-9075-a6950a043d98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:59:38 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d7541-9a64-4791-bc63-fe3ade520fef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630] added
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9aed9c-b60c-4d37-924c-5b5775526197]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[889cd1a6-581e-4199-b259-9db0650224a7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwjyAnOh {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwjyAnOh" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6bc26c-dee4-413c-8709-e214f53425cc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwjyAnOh'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a28ec-a186-4f04-98da-04c5d6d7f951]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[434dcbd6-f3f2-4845-9ea0-60c3b633cfb0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d970d3e-be56-46c0-a535-62909bbf1201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260]
Nov 08 13:59:38 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260] successful.
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[350381fe-c06e-463b-a7bc-63ec3013556d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27faf8e-d831-48ec-88dd-318dbccc22e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:38 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ab915-2fe5-4e1b-8253-86034a98adf6]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:59:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26430323661646462', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430323661646462', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'flavor' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:59:39 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:59:39 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 13:59:39 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:59:39 user nova-compute[87365]:   <serial>18e622e5-001b-4bfe-b75d-b95b12720630</serial>
Nov 08 13:59:39 user nova-compute[87365]: </disk>
Nov 08 13:59:39 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Port 1becc56c-05fc-4353-9bb9-7ed7ad36cbda binding to destination host user is already ACTIVE {{(pid=87365) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No VIF found with MAC fa:16:3e:b5:5b:ad, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:59:40 user nova-compute[87365]: INFO nova.compute.manager [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Terminating instance
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Creating tmpfile /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02/tmp9xhxolmd to verify with other compute node that the instance is on the same shared storage. {{(pid=87365) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7514929f-2d08-46dd-bbdd-15e1aefd7e0f tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.269s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-23f67101-687e-4269-a43f-1bae2049840c req-6c836b1d-b85c-4551-88e4-8286f50b5c73 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-unplugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:40 user nova-compute[87365]: WARNING nova.compute.manager [req-58293096-b1d2-46eb-904f-4d7d6f3f5b8d req-e34e8a6c-b21b-4583-bbcf-0351c0d7b8b0 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-unplugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state resized and task_state resize_reverting.
Nov 08 13:59:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Instance destroyed successfully.
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.objects.instance [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'resources' on Instance uuid 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.compute.manager [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Rescuing
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1096987352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1096987352',id=24,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7GSrNwtZi+QUTBs0XGg3Hyc/mamJ2jeRuv3YWc4nB5YJrJkN57xMdy0xafTS/F7WTUWxI6YxvPGxssn9C8j/b2TaZDYK5mHDa4+iy9kKSbyDkxkQjaCfp4bW+eQJVvwg==',key_name='tempest-keypair-2111570019',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-edvwv0q5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=5d6ef0e9-a59a-4456-9da2-de8ee5a874f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "address": "fa:16:3e:cd:bb:2c", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb853533-e9", "ovs_interfaceid": "eb853533-e9d7-4cec-a4fc-6185232a7b57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_vif [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb853533-e9, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance destroyed successfully.
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'resources' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff26de69-e126-4b25-866a-bf3e5555e24e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_vif [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1becc56c-05, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: INFO os_vif [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:2c,bridge_name='br-int',has_traffic_filtering=True,id=eb853533-e9d7-4cec-a4fc-6185232a7b57,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb853533-e9')
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Deleting instance files /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9_del
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Deletion of /opt/stack/data/nova/instances/5d6ef0e9-a59a-4456-9da2-de8ee5a874f9_del complete
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a97b156-6e59-408f-8c27-800b660ba017) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:41 user nova-compute[87365]: INFO os_vif [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05')
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:41 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[74584725-3f17-46d9-9df8-19b4c483c3ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:59:41 user nova-compute[87365]: No targets found.
Nov 08 13:59:41 user nova-compute[87365]: iSNS:
Nov 08 13:59:41 user nova-compute[87365]: No targets found.
Nov 08 13:59:41 user nova-compute[87365]: STATIC:
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f
Nov 08 13:59:41 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:41 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:41 user nova-compute[87365]: FIRMWARE:
Nov 08 13:59:41 user nova-compute[87365]: No targets found.
Nov 08 13:59:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:59:41 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:59:41 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: INFO nova.compute.manager [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[401cefcc-4d82-40d9-b4a1-7aa122386372]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3191f24-7f22-4407-84e6-d55b90277201]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:41 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4e1b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce6e026-8565-4eeb-bd88-60211c218cca]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5ba5d-c7a0-4ba6-b255-b079e41d5362]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2f245-5053-44eb-9515-2bd8142aa0d7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[599036dc-77e1-4ceb-a281-592b12f3c92c]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a50c1ab-ab8e-46c4-b93e-2eb1c006a31f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c6e8e9-2bd3-4c55-8bea-fa8ced2f6521]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260]
Nov 08 13:59:42 user nova-compute[87365]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e, portal: 172.16.0.220,3260] successful.
Nov 08 13:59:42 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7519f7c-2c1e-4e23-b1f8-f77c3748ff79]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== disconnect_volume: return (472ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] Acquiring lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] No waiting events found dispatching network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:42 user nova-compute[87365]: WARNING nova.compute.manager [req-5b741939-fe82-4a77-92ee-7844275e742b req-8ba238ae-ca96-4f51-b4ca-13bb2459a906 service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received unexpected event network-vif-plugged-eb853533-e9d7-4cec-a4fc-6185232a7b57 for instance with vm_state active and task_state deleting.
Nov 08 13:59:42 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:43 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Took 1.25 seconds to deallocate network for instance.
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] No waiting events found dispatching network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:43 user nova-compute[87365]: WARNING nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received unexpected event network-vif-plugged-1becc56c-05fc-4353-9bb9-7ed7ad36cbda for instance with vm_state resized and task_state resize_reverting.
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:43 user nova-compute[87365]: WARNING nova.compute.manager [req-4b3bfd67-50bb-4a91-ba99-5b59e6f29f1f req-b98476ab-c83f-4e35-92ac-d08c6d009aab service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state active and task_state rescuing.
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:59:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance destroyed successfully.
Nov 08 13:59:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attempting a stable device rescue
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=87365) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 13:59:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Creating image(s)
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "660e8796b2d70c9a556e59fed2592087f46137e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "660e8796b2d70c9a556e59fed2592087f46137e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-65d35fa8-5f3c-403b-b960-c4cf15ee471c req-a55517e2-7f02-43b1-ad74-67306a0c1e1a service nova] [instance: 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9] Received event network-vif-deleted-eb853533-e9d7-4cec-a4fc-6185232a7b57 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:45 user nova-compute[87365]: WARNING nova.compute.manager [req-8e0aab19-b906-43a3-b365-14796fdb0175 req-1cdab153-ebc6-4c5d-9f60-53663c0ec4b3 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state active and task_state rescuing.
Nov 08 13:59:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7030MB free_disk=24.23672103881836GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:45 user nova-compute[87365]: INFO nova.compute.manager [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Terminating instance
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.part --force-share --output=json" returned: 0 in 0.229s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.virt.images [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] 53f14935-2b82-4766-84f4-804d192f3d84 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.part /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-090af09b-efd2-497b-a2ca-512cf714fa6d req-5ffa8793-bca8-4431-912f-31c6a5185370 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-unplugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.785s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 2.391s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'migration_context' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.objects.base [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Object Instance<de510f72-fe85-4b4f-8938-ca8976aaff02> lazy-loaded attributes: resources,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Deleted allocations for instance 5d6ef0e9-a59a-4456-9da2-de8ee5a874f9
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Instance destroyed successfully.
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.objects.instance [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lazy-loading 'resources' on Instance uuid 02327cf5-f6ca-41c9-983c-f74508ef6b46 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2093578167',display_name='tempest-ServerRescueNegativeTestJSON-server-2093578167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2093578167',id=1,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ddd66e9d6104a2c8e71279551cb6b4d',ramdisk_id='',reservation_id='r-cyoj7o71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-954030017',owner_user_name='tempest-ServerRescueNegativeTestJSON-954030017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:50:16Z,user_data=None,user_id='74300a84ce074dd38166c961d57071cd',uuid=02327cf5-f6ca-41c9-983c-f74508ef6b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converting VIF {"id": "fc315d33-8442-42b3-8efd-61482b1fab32", "address": "fa:16:3e:a0:93:c6", "network": {"id": "455c5701-53ea-4305-b98e-f22d3485e96a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2001998075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ddd66e9d6104a2c8e71279551cb6b4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc315d33-84", "ovs_interfaceid": "fc315d33-8442-42b3-8efd-61482b1fab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG os_vif [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc315d33-84, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ddfc839-8fc0-4428-805c-ed080ddf20a4) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: INFO os_vif [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:93:c6,bridge_name='br-int',has_traffic_filtering=True,id=fc315d33-8442-42b3-8efd-61482b1fab32,network=Network(455c5701-53ea-4305-b98e-f22d3485e96a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc315d33-84')
Nov 08 13:59:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Deleting instance files /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46_del
Nov 08 13:59:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Deletion of /opt/stack/data/nova/instances/02327cf5-f6ca-41c9-983c-f74508ef6b46_del complete
Nov 08 13:59:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-62bff9c6-dd79-49dc-959e-41badd62f1a5 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "5d6ef0e9-a59a-4456-9da2-de8ee5a874f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.157s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:46 user nova-compute[87365]: INFO nova.compute.manager [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 08 13:59:46 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.part /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.converted" returned: 0 in 1.409s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:59:46 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.103s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.752s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "660e8796b2d70c9a556e59fed2592087f46137e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.405s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "660e8796b2d70c9a556e59fed2592087f46137e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "660e8796b2d70c9a556e59fed2592087f46137e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9b013f3d-6691-4f2c-be63-a25aa2ac259f has allocations against this compute host but is not found in the database.
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 43d8299d-a8c7-4353-87f1-dcc7a2756c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:59:47 user nova-compute[87365]: INFO nova.compute.manager [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Swapping old allocation on dict_keys(['3e23700a-4955-415f-80cb-af3ae211a65e']) held by migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f for instance
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0 --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0,backing_fmt=raw /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0,backing_fmt=raw /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "660e8796b2d70c9a556e59fed2592087f46137e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'migration_context' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Overwriting current allocation {'allocations': {'3e23700a-4955-415f-80cb-af3ae211a65e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 39}}, 'project_id': 'cf4f3ebf487840099cd65d5c708fe710', 'user_id': '056f4860196044679b260c22a8c83f7f', 'consumer_generation': 1} on consumer de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Object Instance<c6f0552a-24eb-4d72-8b92-49cd8da619e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start _get_guest_xml network_info=[{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "vif_mac": "fa:16:3e:b5:5b:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '53f14935-2b82-4766-84f4-804d192f3d84', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c6f0552a-24eb-4d72-8b92-49cd8da619e9', 'attached_at': '', 'detached_at': '', 'volume_id': '18e622e5-001b-4bfe-b75d-b95b12720630', 'serial': '18e622e5-001b-4bfe-b75d-b95b12720630'}, 'attachment_id': '5c29309a-4493-4e57-b98f-0d78aaf4d473', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'resources' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Object Instance<c6f0552a-24eb-4d72-8b92-49cd8da619e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'numa_topology' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Object Instance<c6f0552a-24eb-4d72-8b92-49cd8da619e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:47 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Took 0.78 seconds to deallocate network for instance.
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-0578c143-7b34-49b5-b1eb-92025415ff6f req-70aa3abf-a4fe-4098-b6e0-3c6b8139d9ff service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-deleted-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:47 user nova-compute[87365]: INFO nova.compute.manager [req-0578c143-7b34-49b5-b1eb-92025415ff6f req-70aa3abf-a4fe-4098-b6e0-3c6b8139d9ff service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Neutron deleted interface fc315d33-8442-42b3-8efd-61482b1fab32; detaching it from the instance and deleting it from the info cache
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-0578c143-7b34-49b5-b1eb-92025415ff6f req-70aa3abf-a4fe-4098-b6e0-3c6b8139d9ff service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Object Instance<c6f0552a-24eb-4d72-8b92-49cd8da619e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:47 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-0578c143-7b34-49b5-b1eb-92025415ff6f req-70aa3abf-a4fe-4098-b6e0-3c6b8139d9ff service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Detach interface failed, port_id=fc315d33-8442-42b3-8efd-61482b1fab32, reason: Instance 02327cf5-f6ca-41c9-983c-f74508ef6b46 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1454ef-44ae-4a10-9018-f8f8102b6d31]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iwjyAnOh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 13:59:47 user nova-compute[87365]: node.name = iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 13:59:47 user nova-compute[87365]: node.tpgt = -1
Nov 08 13:59:47 user nova-compute[87365]: node.startup = automatic
Nov 08 13:59:47 user nova-compute[87365]: node.leading_login = No
Nov 08 13:59:47 user nova-compute[87365]: iface.iscsi_ifacename = default
Nov 08 13:59:47 user nova-compute[87365]: iface.net_ifacename = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.ipaddress = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.prefix_len = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.hwaddress = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.transport_name = tcp
Nov 08 13:59:47 user nova-compute[87365]: iface.initiatorname = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.vlan_id = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.vlan_priority = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.vlan_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.iface_num = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.mtu = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.port = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.bootproto = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.subnet_mask = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.gateway = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_alt_client_id = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_dns = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_learn_iqn = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_vendor_id_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_vendor_id = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.dhcp_slp_da = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.fragmentation = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.gratuitous_arp = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.incoming_forwarding = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.tos_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.tos = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.ttl = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.delayed_ack = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.tcp_nagle = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.tcp_wsf_state = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.tcp_wsf = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.tcp_timer_scale = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.tcp_timestamp = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.redirect = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.def_task_mgmt_timeout = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.header_digest = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.data_digest = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.immediate_data = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.initial_r2t = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.data_seq_inorder = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.data_pdu_inorder = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.erl = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.max_receive_data_len = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.first_burst_len = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.max_outstanding_r2t = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.max_burst_len = 0
Nov 08 13:59:47 user nova-compute[87365]: iface.chap_auth = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.bidi_chap = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.strict_login_compliance = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.discovery_auth = <empty>
Nov 08 13:59:47 user nova-compute[87365]: iface.discovery_logout = <empty>
Nov 08 13:59:47 user nova-compute[87365]: node.discovery_address = <empty>
Nov 08 13:59:47 user nova-compute[87365]: node.discovery_port = 0
Nov 08 13:59:47 user nova-compute[87365]: node.discovery_type = static
Nov 08 13:59:47 user nova-compute[87365]: node.session.initial_cmdsn = 0
Nov 08 13:59:47 user nova-compute[87365]: node.session.initial_login_retry_max = 8
Nov 08 13:59:47 user nova-compute[87365]: node.session.xmit_thread_priority = -20
Nov 08 13:59:47 user nova-compute[87365]: node.session.cmds_max = 128
Nov 08 13:59:47 user nova-compute[87365]: node.session.queue_depth = 32
Nov 08 13:59:47 user nova-compute[87365]: node.session.nr_sessions = 1
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.authmethod = CHAP
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.username = iwjyAnOh
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.password = ***
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.username_in = <empty>
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.password_in = <empty>
Nov 08 13:59:47 user nova-compute[87365]: node.session.auth.chap_algs = MD5
Nov 08 13:59:47 user nova-compute[87365]: node.session.timeo.replacement_timeout = 120
Nov 08 13:59:47 user nova-compute[87365]: node.session.err_timeo.abort_timeout = 15
Nov 08 13:59:47 user nova-compute[87365]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 13:59:47 user nova-compute[87365]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 13:59:47 user nova-compute[87365]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.FastAbort = Yes
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.InitialR2T = No
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.ImmediateData = Yes
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.MaxConnections = 1
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 13:59:47 user nova-compute[87365]: node.session.iscsi.ERL = 0
Nov 08 13:59:47 user nova-compute[87365]: node.session.scan = manual
Nov 08 13:59:47 user nova-compute[87365]: node.session.reopen_max = 0
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].address = 172.16.0.220
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].port = 3260
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].startup = manual
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].tcp.window_size = 524288
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].tcp.type_of_service = 0
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].timeo.logout_timeout = 15
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].timeo.login_timeout = 15
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].timeo.auth_timeout = 45
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.DataDigest = None
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.IFMarker = No
Nov 08 13:59:47 user nova-compute[87365]: node.conn[0].iscsi.OFMarker = No
Nov 08 13:59:47 user nova-compute[87365]: # END RECORD
Nov 08 13:59:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8927b3-c7e8-4e80-9b30-18dee5213073]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquired lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1062410-9b46-4a41-8981-73be91a1b318]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwjyAnOh {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwjyAnOh" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc15d1a-24b6-452a-b1d2-b6e1c8321212]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwjyAnOh'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ecada3-455e-4185-95ba-fb16984656e3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56c2fd-40a2-42c7-82cb-76e9067771cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:47 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] HCTL ('36', '0', '0', 0) found on session 29 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[543a0a1d-637f-4158-8921-360dd830e694]: (4, ('0 0 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Searching for a device in session 29 and hctl ('36', '0', '0', 0) yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26430323661646462', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430323661646462', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1986300821',display_name='tempest-ServerStableDeviceRescueTest-server-1986300821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1986300821',id=29,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHQNoEXYhLnfLfy+FmAgNjJ2gsqF4fOUbmjMgcGaXVrAjwSL5VYkLGh3IhSaslDmUe8724n0XH5oXkcKCzB2fA/Z8o8a7GI704gvT0QLsFUSCzkh+pIQ8xSeLNDiXWDWA==',key_name='tempest-keypair-2030627838',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f05f6965be17462d8c1447838b4437f6',ramdisk_id='',reservation_id='r-ov72t729',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-542592970',owner_user_name='tempest-ServerStableDeviceRescueTest-542592970-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aed7fbc5c4f4736a2d5ac621c413c76',uuid=c6f0552a-24eb-4d72-8b92-49cd8da619e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "vif_mac": "fa:16:3e:b5:5b:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converting VIF {"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "vif_mac": "fa:16:3e:b5:5b:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'pci_devices' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.objects.base [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Object Instance<c6f0552a-24eb-4d72-8b92-49cd8da619e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:59:47 user nova-compute[87365]:   <uuid>c6f0552a-24eb-4d72-8b92-49cd8da619e9</uuid>
Nov 08 13:59:47 user nova-compute[87365]:   <name>instance-0000001d</name>
Nov 08 13:59:47 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 13:59:47 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 13:59:47 user nova-compute[87365]:   <metadata>
Nov 08 13:59:47 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:59:47 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1986300821</nova:name>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:creationTime>2023-11-08 13:59:47</nova:creationTime>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 13:59:47 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:59:47 user nova-compute[87365]:       </nova:flavor>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:owner>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:user uuid="1aed7fbc5c4f4736a2d5ac621c413c76">tempest-ServerStableDeviceRescueTest-542592970-project-member</nova:user>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:project uuid="f05f6965be17462d8c1447838b4437f6">tempest-ServerStableDeviceRescueTest-542592970</nova:project>
Nov 08 13:59:47 user nova-compute[87365]:       </nova:owner>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 13:59:47 user nova-compute[87365]:       <nova:ports>
Nov 08 13:59:47 user nova-compute[87365]:         <nova:port uuid="01452ad0-a98c-47bb-a3b5-3b95526facf2">
Nov 08 13:59:47 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 13:59:47 user nova-compute[87365]:         </nova:port>
Nov 08 13:59:47 user nova-compute[87365]:       </nova:ports>
Nov 08 13:59:47 user nova-compute[87365]:     </nova:instance>
Nov 08 13:59:47 user nova-compute[87365]:   </metadata>
Nov 08 13:59:47 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 13:59:47 user nova-compute[87365]:     <system>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="serial">c6f0552a-24eb-4d72-8b92-49cd8da619e9</entry>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="uuid">c6f0552a-24eb-4d72-8b92-49cd8da619e9</entry>
Nov 08 13:59:47 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:59:47 user nova-compute[87365]:     </system>
Nov 08 13:59:47 user nova-compute[87365]:   </sysinfo>
Nov 08 13:59:47 user nova-compute[87365]:   <os>
Nov 08 13:59:47 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:59:47 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 13:59:47 user nova-compute[87365]:   </os>
Nov 08 13:59:47 user nova-compute[87365]:   <features>
Nov 08 13:59:47 user nova-compute[87365]:     <acpi/>
Nov 08 13:59:47 user nova-compute[87365]:     <apic/>
Nov 08 13:59:47 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 13:59:47 user nova-compute[87365]:   </features>
Nov 08 13:59:47 user nova-compute[87365]:   <clock offset="utc">
Nov 08 13:59:47 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:59:47 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:59:47 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 13:59:47 user nova-compute[87365]:   </clock>
Nov 08 13:59:47 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 13:59:47 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 13:59:47 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:59:47 user nova-compute[87365]:   </cpu>
Nov 08 13:59:47 user nova-compute[87365]:   <devices>
Nov 08 13:59:47 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:59:47 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:59:47 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk"/>
Nov 08 13:59:47 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 13:59:47 user nova-compute[87365]:     </disk>
Nov 08 13:59:47 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 13:59:47 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:59:47 user nova-compute[87365]:       <source dev="/dev/sde"/>
Nov 08 13:59:47 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 13:59:47 user nova-compute[87365]:       <serial>18e622e5-001b-4bfe-b75d-b95b12720630</serial>
Nov 08 13:59:47 user nova-compute[87365]:     </disk>
Nov 08 13:59:47 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 13:59:47 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:59:47 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue"/>
Nov 08 13:59:47 user nova-compute[87365]:       <target dev="vdc" bus="virtio"/>
Nov 08 13:59:47 user nova-compute[87365]:       <boot order="1"/>
Nov 08 13:59:47 user nova-compute[87365]:     </disk>
Nov 08 13:59:47 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 13:59:47 user nova-compute[87365]:       <mac address="fa:16:3e:b5:5b:ad"/>
Nov 08 13:59:47 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:59:47 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 13:59:47 user nova-compute[87365]:       <target dev="tap01452ad0-a9"/>
Nov 08 13:59:47 user nova-compute[87365]:     </interface>
Nov 08 13:59:47 user nova-compute[87365]:     <serial type="pty">
Nov 08 13:59:47 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/console.log" append="off"/>
Nov 08 13:59:47 user nova-compute[87365]:     </serial>
Nov 08 13:59:47 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:59:47 user nova-compute[87365]:     <video>
Nov 08 13:59:47 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 13:59:47 user nova-compute[87365]:     </video>
Nov 08 13:59:47 user nova-compute[87365]:     <rng model="virtio">
Nov 08 13:59:47 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:59:47 user nova-compute[87365]:     </rng>
Nov 08 13:59:47 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:59:47 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 13:59:47 user nova-compute[87365]:       <stats period="10"/>
Nov 08 13:59:47 user nova-compute[87365]:     </memballoon>
Nov 08 13:59:47 user nova-compute[87365]:   </devices>
Nov 08 13:59:47 user nova-compute[87365]: </domain>
Nov 08 13:59:47 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.244s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:59:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance destroyed successfully.
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 0 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] No VIF found with MAC fa:16:3e:b5:5b:ad, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] Acquiring lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] No waiting events found dispatching network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:47 user nova-compute[87365]: WARNING nova.compute.manager [req-1aeaa98c-9596-4f1d-b74c-5140f81319d0 req-45fec0ba-f73b-45ea-94ac-1dbc6d4ceeb7 service nova] [instance: 02327cf5-f6ca-41c9-983c-f74508ef6b46] Received unexpected event network-vif-plugged-fc315d33-8442-42b3-8efd-61482b1fab32 for instance with vm_state deleted and task_state None.
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [{"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Releasing lock "refresh_cache-de510f72-fe85-4b4f-8938-ca8976aaff02" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.utils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95e3e4-a3e8-411e-832b-87d3b68fffaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2beb025-2a94-4b01-8085-13bf79bbbe47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb59afb-891a-42dd-9d1d-7be04a1275ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b89f1c-ad78-4690-86dd-19ed8f2b55fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:59:48 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a515a52-3292-44f6-812c-e9fed69c8c98 is timed out.
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:59:48 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a00d1-0503-4591-a822-1b494903cb63]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully detached device vdb from instance 3a515a52-3292-44f6-812c-e9fed69c8c98 from the live domain config.
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.utils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhVfmwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:59:48 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ff3a6-354b-4115-a450-9fac44d78ba8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:59:48 user nova-compute[87365]: No targets found.
Nov 08 13:59:48 user nova-compute[87365]: iSNS:
Nov 08 13:59:48 user nova-compute[87365]: No targets found.
Nov 08 13:59:48 user nova-compute[87365]: STATIC:
Nov 08 13:59:48 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7
Nov 08 13:59:48 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:48 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:48 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 13:59:48 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:48 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:48 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 13:59:48 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:48 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:48 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 13:59:48 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:48 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:48 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f
Nov 08 13:59:48 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:59:48 user nova-compute[87365]:                 Iface Name: default
Nov 08 13:59:48 user nova-compute[87365]: FIRMWARE:
Nov 08 13:59:48 user nova-compute[87365]: No targets found.
Nov 08 13:59:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:59:48 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:59:48 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:59:48 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Deleted allocations for instance 02327cf5-f6ca-41c9-983c-f74508ef6b46
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[002a993b-9e23-4f65-85a3-5d452aa23730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b6af13-bff2-4f37-97e6-ed42c9aec307]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 13:59:48 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 13:59:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d253bf010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0413a701-cf10-4b91-9578-08ecc36d6ba0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c53b275-9458-4d50-b86f-3fc158a6df34]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ebe34a-0416-48e7-b11e-f52508ed07f5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb82d4-1ce0-45b0-9abd-625f5f8967bf]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-22d79c06-b4f3-4037-918f-f69cd7a423f3 tempest-ServerRescueNegativeTestJSON-954030017 tempest-ServerRescueNegativeTestJSON-954030017-project-member] Lock "02327cf5-f6ca-41c9-983c-f74508ef6b46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700266e-0ce9-4340-9afd-abc8e0ae48e1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[142371ba-8b24-48a6-b607-68912c42885b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260]
Nov 08 13:59:48 user nova-compute[87365]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7, portal: 172.16.0.220,3260] successful.
Nov 08 13:59:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762392b-a9e4-484d-918e-60f99f1caece]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== disconnect_volume: return (371ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:59:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [{"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b3bc6678-0f78-4778-9a0d-95e0a7c3e690" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:59:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:50 user nova-compute[87365]: WARNING nova.compute.manager [req-dd1e902b-126f-4d77-97ef-b2a365c9be7b req-874c92d2-0338-4846-9504-66269df8af86 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state active and task_state rescuing.
Nov 08 13:59:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2b627ee4-e9d7-4a3c-bbfd-f028ac630bc3 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:59:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:59:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:59:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:59:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:59:52 user nova-compute[87365]: DEBUG nova.compute.manager [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:59:52 user nova-compute[87365]: WARNING nova.compute.manager [req-abf84708-875c-4d58-8a81-b5ecac28a2e9 req-ba532d1b-6b67-453b-9956-34069c19eb6d service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state rescued and task_state None.
Nov 08 13:59:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:59:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.objects.instance [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3d697a12-67db-47c1-a048-d6375ce35a0e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 47.489s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 47.343s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:15 user nova-compute[87365]: INFO nova.compute.manager [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Terminating instance
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxSFpLfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:00:15 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:00:15 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:00:15 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9b919-a52f-4180-9ab6-d277dbe90b97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:00:15 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057557a-c3a0-4c8e-9628-5c2c426754f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6] added
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7d0b43-4b86-423c-a7d5-e53fa005f367]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e37ef-1d75-4c82-b459-76f86a510b91]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxSFpLfV {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxSFpLfV" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c089a-7a80-4787-915f-9b67c1861385]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxSFpLfV'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d297022d-6662-4c18-a06d-584551e7b8e7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696c195-18da-4fb7-93f5-aa77ec775ade]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-unplugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] No waiting events found dispatching network-vif-unplugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-f94df6d9-ba84-4514-96ef-99fdc9f398bc req-3e5efe17-b5cf-4737-a9ef-2c00eca169ac service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-unplugged-9db37f62-28a7-47c5-89f4-0d121d9e504d for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1cf241-5a2e-458a-9973-150951a00031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.volume.cinder [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Update attachment failed for attachment 467cc2dc-c83c-4f56-b558-872595f2a95d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Traceback (most recent call last):
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     yield
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/compute/manager.py", line 5486, in _finish_revert_resize
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     self._update_volume_attachments(context, instance, bdms)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     self.volume_api.attachment_update(
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     res = method(self, ctx, *args, **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     with excutils.save_and_reraise_exception():
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     self.force_reraise()
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     raise self.value
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     return method.func(obj, *args, **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     resp = self._update('/attachments/%s' % id, body)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     return self.request(url, method, **kwargs)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02]     raise exceptions.from_response(resp, body)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b)
Nov 08 14:00:15 user nova-compute[87365]: ERROR nova.compute.manager [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] 
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260]
Nov 08 14:00:15 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260] successful.
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33e6c1-9b06-437e-8916-7b24e0d94849]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0201d3-4e4c-4b46-96d4-b1938f0a7180]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ddccf7-3e59-4254-aa37-7071ad7ba6ad]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxSFpLfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Instance destroyed successfully.
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'resources' on Instance uuid 3a515a52-3292-44f6-812c-e9fed69c8c98 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-642759649',display_name='tempest-VolumesSnapshotTestJSON-instance-642759649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-642759649',id=28,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsah0JeYobUmweI1N9BA0GuHwlWSG55bdXzCixls7QnhOwREOHs6hxpj/DWA2EX7vtanHkHWB8ctbcz6J/oXRnh0jdIXhHiJeSG/UlvSKME1Yv7Sq2sLWE6UPjjF4Psg==',key_name='tempest-keypair-715435644',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-xchun9h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=3a515a52-3292-44f6-812c-e9fed69c8c98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "address": "fa:16:3e:cf:8c:ec", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db37f62-28", "ovs_interfaceid": "9db37f62-28a7-47c5-89f4-0d121d9e504d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_vif [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9db37f62-28, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f628610f-0304-426a-9ffb-1fa8fc0ab0e8) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:00:16 user nova-compute[87365]: INFO os_vif [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:8c:ec,bridge_name='br-int',has_traffic_filtering=True,id=9db37f62-28a7-47c5-89f4-0d121d9e504d,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db37f62-28')
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZhVfmwiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:00:16 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:16 user nova-compute[87365]: INFO nova.compute.manager [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Successfully reverted task state from resize_reverting on failure for instance.
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-5a390a15-0eaa-4533-a02f-9b7ad42567e3 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5420, in finish_revert_resize
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._finish_revert_resize(
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5486, in _finish_revert_resize
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1e5b77f5-a2e5-4b23-8316-891a9461b62b)
Nov 08 14:00:16 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 14:00:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23263356666666334', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263356666666334', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.668s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb730f4-a22d-4fd0-aaf0-b049dbe1c8f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:00:16 user nova-compute[87365]: No targets found.
Nov 08 14:00:16 user nova-compute[87365]: iSNS:
Nov 08 14:00:16 user nova-compute[87365]: No targets found.
Nov 08 14:00:16 user nova-compute[87365]: STATIC:
Nov 08 14:00:16 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:00:16 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:00:16 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:00:16 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:00:16 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:00:16 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:00:16 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:00:16 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:00:16 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:00:16 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f
Nov 08 14:00:16 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:00:16 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:00:16 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6
Nov 08 14:00:16 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:00:16 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:00:16 user nova-compute[87365]: FIRMWARE:
Nov 08 14:00:16 user nova-compute[87365]: No targets found.
Nov 08 14:00:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:00:16 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:00:16 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:219e9157-c4db-4d09-8ec3-5a090612d6b7', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:00:16 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:16 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:00:16 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:16 user nova-compute[87365]:   <serial>819974d7-9e91-48b4-b2b2-12c5f7af83f6</serial>
Nov 08 14:00:16 user nova-compute[87365]: </disk>
Nov 08 14:00:16 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092c177-3629-415a-aadf-effafd6b002b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3ba75-06b3-407f-a153-ae508556f72a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:16 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4e19a20>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== disconnect_volume: return (757ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:00:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Deleting instance files /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98_del
Nov 08 14:00:16 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Deletion of /opt/stack/data/nova/instances/3a515a52-3292-44f6-812c-e9fed69c8c98_del complete
Nov 08 14:00:16 user nova-compute[87365]: INFO nova.compute.manager [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 08 14:00:16 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:00:16 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No VIF found with MAC fa:16:3e:65:d0:12, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-97b4f815-65ec-4227-a54d-db5f3c9f8cae tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.575s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] Acquiring lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] No waiting events found dispatching network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:17 user nova-compute[87365]: WARNING nova.compute.manager [req-acbae7af-2da0-4ed5-a0b1-bd9c48867066 req-74561f71-4a46-45eb-b281-cbf51fef4db9 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received unexpected event network-vif-plugged-9db37f62-28a7-47c5-89f4-0d121d9e504d for instance with vm_state active and task_state deleting.
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-94d9db07-679c-409e-86ca-0b7d4485554e req-a5ffe70e-b50d-4ffa-bb9a-d2aeeae3ff79 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Received event network-vif-deleted-9db37f62-28a7-47c5-89f4-0d121d9e504d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:17 user nova-compute[87365]: INFO nova.compute.manager [req-94d9db07-679c-409e-86ca-0b7d4485554e req-a5ffe70e-b50d-4ffa-bb9a-d2aeeae3ff79 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Neutron deleted interface 9db37f62-28a7-47c5-89f4-0d121d9e504d; detaching it from the instance and deleting it from the info cache
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-94d9db07-679c-409e-86ca-0b7d4485554e req-a5ffe70e-b50d-4ffa-bb9a-d2aeeae3ff79 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:17 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Took 0.74 seconds to deallocate network for instance.
Nov 08 14:00:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-94d9db07-679c-409e-86ca-0b7d4485554e req-a5ffe70e-b50d-4ffa-bb9a-d2aeeae3ff79 service nova] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Detach interface failed, port_id=9db37f62-28a7-47c5-89f4-0d121d9e504d, reason: Instance 3a515a52-3292-44f6-812c-e9fed69c8c98 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:00:17 user nova-compute[87365]: WARNING nova.volume.cinder [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Attachment 634d6268-0f0d-4056-96fb-925b85132b7e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 634d6268-0f0d-4056-96fb-925b85132b7e. (HTTP 404) (Request-ID: req-b99b0126-c59d-4091-9131-884c8d8f04bb)
Nov 08 14:00:17 user nova-compute[87365]: INFO nova.compute.manager [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 3a515a52-3292-44f6-812c-e9fed69c8c98] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:18 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:00:18 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:00:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:18 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Deleted allocations for instance 3a515a52-3292-44f6-812c-e9fed69c8c98
Nov 08 14:00:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c6638243-5769-4b41-89a6-cdaa81f7e27e tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "3a515a52-3292-44f6-812c-e9fed69c8c98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.104s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing instance network info cache due to event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:00:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] Acquiring lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] Acquired lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:19 user nova-compute[87365]: DEBUG nova.network.neutron [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updated VIF entry in instance network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0f0cdc76-6155-4cd1-a16d-920cebd4433f req-1c1906c4-14ae-4a5d-bab4-e2960ec93f16 service nova] Releasing lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:20 user nova-compute[87365]: INFO nova.compute.manager [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Attaching volume a19ea59b-dfe4-4985-a6f9-6490cde28bc3 to /dev/vdb
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.utils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5d9231-72f2-4432-8709-db85b30667be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e284721-efce-4d9e-8ca4-c99e9e928b85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cd8273-1cd0-489e-a343-2c969fd13c30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52b4ac-fd25-40d8-a5f2-17a1f62b00ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:00:20 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:00:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba4eb60-fa72-49cf-97f1-20bb0f946dad]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG os_brick.utils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:00:20 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating existing volume attachment record: c294af04-b6f2-463e-9a84-685f93f68dea {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:00:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:30 user nova-compute[87365]: INFO nova.compute.manager [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Unrescuing
Nov 08 14:00:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquired lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG nova.network.neutron [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating instance_info_cache with network_info: [{"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Releasing lock "refresh_cache-3c7723ce-8e93-40d9-94f8-35767b220322" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG nova.objects.instance [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'flavor' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:31 user nova-compute[87365]: WARNING nova.compute.manager [req-6ae3a3d4-4b88-4cf1-a1c3-c23d5b2580a8 req-869aa2b9-e11f-4871-89c1-27ced8c51d85 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance destroyed successfully.
Nov 08 14:00:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:33 user nova-compute[87365]: WARNING nova.compute.manager [req-048af706-bd8d-48e0-b2a1-9465bb9fba68 req-bcdcf869-0772-4e92-a951-2da8d669c2a6 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:00:34 user nova-compute[87365]: INFO nova.compute.claims [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Claim successful on node user
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:00:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.353s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:00:35 user nova-compute[87365]: INFO nova.compute.claims [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Claim successful on node user
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:00:35 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.policy [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b64c48aad8f24a63a24044d7e803b2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3523c776dd47cdbae107f85e075ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:00:35 user nova-compute[87365]: INFO nova.virt.block_device [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Booting with volume eae0d4c1-f3c3-4ac8-8919-affeab99faec at /dev/vda
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:35 user nova-compute[87365]: WARNING nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:35 user nova-compute[87365]: WARNING nova.compute.manager [req-5b9d1d48-91e7-4c98-93f6-cbc78c5be09e req-d003b0bf-b25a-436c-aa4f-8726bc42d09b service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.utils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26336dc-3011-4a31-a592-0b57d15933f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e5049-9381-4818-9955-7932eccadac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e3d039-4638-4ecb-8888-32eb38d73117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f58d95-88b4-432a-b05a-07d3da0391d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-561d7996-06a2-48a8-8193-a3a6c00fb454 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:00:35 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:00:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253a43a-5195-40ae-b472-3bf801de9af3]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG os_brick.utils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:00:35 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating existing volume attachment record: 5f52bb59-8914-4028-beac-038eae3d9993 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:00:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.policy [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ad4efa600524c27a048bd565bf1852c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9d5da6823541c282006a7871e50ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:00:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Creating image(s)
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Successfully created port: b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk 1073741824" returned: 0 in 0.075s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:36 user nova-compute[87365]: WARNING nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] While synchronizing instance power states, found 13 instances in the database and 9 instances on the hypervisor.
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid b3bc6678-0f78-4778-9a0d-95e0a7c3e690 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 43d8299d-a8c7-4353-87f1-dcc7a2756c94 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.194s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Cannot resize image /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Ensure instance console log exists: /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Successfully created port: b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Successfully updated port: b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing instance network info cache due to event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance network_info: |[{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Successfully updated port: b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updated VIF entry in instance network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5905146c-10df-4a57-9278-3aa04edbfdf6 req-30ad2bac-8b52-4e1a-a14f-b6b34b36cfb8 service nova] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance network_info: |[{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start _get_guest_xml network_info=[{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:00:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:00:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:00:39 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDUBGcqq2BmB+uPwsl58TRaHqM5TXEFZDnV/bYelqjCl/To2qZAK7iYTr1UKVoSxiLBjZBywxCl8mIvUJGEkgD94gW66mSxLnqbfxjph/rfE+ePgPqHzAH0pwjxbEC1BA==',key_name='tempest-keypair-1486094982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:00:40 user nova-compute[87365]:   <uuid>8d77f463-f4c6-44a1-94ba-ce5b5e04b257</uuid>
Nov 08 14:00:40 user nova-compute[87365]:   <name>instance-00000023</name>
Nov 08 14:00:40 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:00:40 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:00:40 user nova-compute[87365]:   <metadata>
Nov 08 14:00:40 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:00:40 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-740798959</nova:name>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:00:39</nova:creationTime>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:00:40 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:00:40 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:owner>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:user uuid="3ad4efa600524c27a048bd565bf1852c">tempest-AttachVolumeShelveTestJSON-1136658600-project-member</nova:user>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:project uuid="8f9d5da6823541c282006a7871e50ca8">tempest-AttachVolumeShelveTestJSON-1136658600</nova:project>
Nov 08 14:00:40 user nova-compute[87365]:       </nova:owner>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:00:40 user nova-compute[87365]:       <nova:ports>
Nov 08 14:00:40 user nova-compute[87365]:         <nova:port uuid="b1757412-0b82-41e5-b5ce-f344e9d9f47e">
Nov 08 14:00:40 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 14:00:40 user nova-compute[87365]:         </nova:port>
Nov 08 14:00:40 user nova-compute[87365]:       </nova:ports>
Nov 08 14:00:40 user nova-compute[87365]:     </nova:instance>
Nov 08 14:00:40 user nova-compute[87365]:   </metadata>
Nov 08 14:00:40 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:00:40 user nova-compute[87365]:     <system>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="serial">8d77f463-f4c6-44a1-94ba-ce5b5e04b257</entry>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="uuid">8d77f463-f4c6-44a1-94ba-ce5b5e04b257</entry>
Nov 08 14:00:40 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:00:40 user nova-compute[87365]:     </system>
Nov 08 14:00:40 user nova-compute[87365]:   </sysinfo>
Nov 08 14:00:40 user nova-compute[87365]:   <os>
Nov 08 14:00:40 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:00:40 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:00:40 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:00:40 user nova-compute[87365]:   </os>
Nov 08 14:00:40 user nova-compute[87365]:   <features>
Nov 08 14:00:40 user nova-compute[87365]:     <acpi/>
Nov 08 14:00:40 user nova-compute[87365]:     <apic/>
Nov 08 14:00:40 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:00:40 user nova-compute[87365]:   </features>
Nov 08 14:00:40 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:00:40 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:00:40 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:00:40 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:00:40 user nova-compute[87365]:   </clock>
Nov 08 14:00:40 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:00:40 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:00:40 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:00:40 user nova-compute[87365]:   </cpu>
Nov 08 14:00:40 user nova-compute[87365]:   <devices>
Nov 08 14:00:40 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:00:40 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:00:40 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk"/>
Nov 08 14:00:40 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:00:40 user nova-compute[87365]:     </disk>
Nov 08 14:00:40 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:00:40 user nova-compute[87365]:       <mac address="fa:16:3e:96:f1:3b"/>
Nov 08 14:00:40 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:00:40 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:00:40 user nova-compute[87365]:       <target dev="tapb1757412-0b"/>
Nov 08 14:00:40 user nova-compute[87365]:     </interface>
Nov 08 14:00:40 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:00:40 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/console.log" append="off"/>
Nov 08 14:00:40 user nova-compute[87365]:     </serial>
Nov 08 14:00:40 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:00:40 user nova-compute[87365]:     <video>
Nov 08 14:00:40 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:00:40 user nova-compute[87365]:     </video>
Nov 08 14:00:40 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:00:40 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:00:40 user nova-compute[87365]:     </rng>
Nov 08 14:00:40 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:00:40 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:00:40 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:00:40 user nova-compute[87365]:     </memballoon>
Nov 08 14:00:40 user nova-compute[87365]:   </devices>
Nov 08 14:00:40 user nova-compute[87365]: </domain>
Nov 08 14:00:40 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDUBGcqq2BmB+uPwsl58TRaHqM5TXEFZDnV/bYelqjCl/To2qZAK7iYTr1UKVoSxiLBjZBywxCl8mIvUJGEkgD94gW66mSxLnqbfxjph/rfE+ePgPqHzAH0pwjxbEC1BA==',key_name='tempest-keypair-1486094982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG os_vif [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e284a37-47c1-5f16-97ea-73c01a361f89', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1757412-0b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1757412-0b, col_values=(('qos', UUID('79e218fa-5689-428a-be09-beb29d5ea02e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1757412-0b, col_values=(('external_ids', {'iface-id': 'b1757412-0b82-41e5-b5ce-f344e9d9f47e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f1:3b', 'vm-uuid': '8d77f463-f4c6-44a1-94ba-ce5b5e04b257'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:40 user nova-compute[87365]: INFO os_vif [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b')
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No VIF found with MAC fa:16:3e:96:f1:3b, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing instance network info cache due to event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updated VIF entry in instance network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ee4935a-17b0-4fd3-a3fd-8e3af8d2edb2 req-a734fa63-ef78-483b-a27d-e7f5b71a60b8 service nova] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:42 user nova-compute[87365]: WARNING nova.compute.manager [req-c4999538-15fd-49ac-a489-9fa30bd25536 req-a8dcb56e-da7e-490e-a1d6-358c6a32509b service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state building and task_state spawning.
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:00:44 user nova-compute[87365]: WARNING nova.compute.manager [req-6f9815e7-88a6-466f-a41f-e75506f96f18 req-0fda4f30-c2cf-4d4d-aca7-135f94ce80f4 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state building and task_state spawning.
Nov 08 14:00:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:00:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=24.212345123291016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:44 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance spawned successfully.
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Applying migration context for instance de510f72-fe85-4b4f-8938-ca8976aaff02 as it has an incoming, in-progress migration 9b013f3d-6691-4f2c-be63-a25aa2ac259f. Migration status is error {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 14:00:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=87365) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 08 14:00:45 user nova-compute[87365]: INFO nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Took 8.64 seconds to spawn the instance on the hypervisor.
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance de510f72-fe85-4b4f-8938-ca8976aaff02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 43d8299d-a8c7-4353-87f1-dcc7a2756c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:45 user nova-compute[87365]: INFO nova.compute.manager [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Took 10.22 seconds to build instance.
Nov 08 14:00:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5787d471-8869-4d19-80fe-8a53d3cbd2d3 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.328s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.207s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:45 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 14:00:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:00:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.816s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:00:46 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDqLJIjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:00:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:00:47 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:00:47 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce0ced1-96d9-476e-bcde-fbf7781589bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:00:47 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bf101-7a26-47e8-b430-83e0f1a08810]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3] added
Nov 08 14:00:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d5ae7-06c4-4cca-b559-38aed1f8c9f2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d55bfd9-c84d-46d4-a7ea-128e7d94afd6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDqLJIjN {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDqLJIjN" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[30abfb8e-1160-4279-8b46-7390f1499f57]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDqLJIjN'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f80404c-07c5-408d-b621-92501637acf2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f12f50-f096-4bbe-a4e9-21db78d6bcdc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:47 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:47 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:00:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42916e20-6eef-4b0c-a4d0-3ba6416b7352]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260]
Nov 08 14:00:48 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260] successful.
Nov 08 14:00:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1932da8-9906-42ca-80de-bec8c3aef165]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7e0df8-9b76-4d1a-8707-b78183e788f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:00:48 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6706370-a126-4d12-a801-31741094816e]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:00:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDqLJIjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26533396534326337', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533396534326337', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.objects.instance [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:00:49 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:49 user nova-compute[87365]:   <source dev="/dev/sdf"/>
Nov 08 14:00:49 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:49 user nova-compute[87365]:   <serial>a19ea59b-dfe4-4985-a6f9-6490cde28bc3</serial>
Nov 08 14:00:49 user nova-compute[87365]: </disk>
Nov 08 14:00:49 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No VIF found with MAC fa:16:3e:4d:05:52, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-92f1c0d0-5ca5-4ac1-95cc-be938130c900 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.103s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.936s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:00:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:52 user nova-compute[87365]: INFO nova.compute.manager [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Detaching volume a19ea59b-dfe4-4985-a6f9-6490cde28bc3
Nov 08 14:00:52 user nova-compute[87365]: INFO nova.virt.block_device [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Attempting to driver detach volume a19ea59b-dfe4-4985-a6f9-6490cde28bc3 from mountpoint /dev/vdb
Nov 08 14:00:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Attempting to detach device vdb from instance 41b54c9e-bc8b-4f7b-8203-628370bb251a from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:00:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:00:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:52 user nova-compute[87365]:   <source dev="/dev/sdf"/>
Nov 08 14:00:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:52 user nova-compute[87365]:   <serial>a19ea59b-dfe4-4985-a6f9-6490cde28bc3</serial>
Nov 08 14:00:52 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:00:52 user nova-compute[87365]: </disk>
Nov 08 14:00:52 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:00:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully detached device vdb from instance 41b54c9e-bc8b-4f7b-8203-628370bb251a from the persistent domain config.
Nov 08 14:00:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41b54c9e-bc8b-4f7b-8203-628370bb251a from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:00:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:00:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:52 user nova-compute[87365]:   <source dev="/dev/sdf"/>
Nov 08 14:00:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:52 user nova-compute[87365]:   <serial>a19ea59b-dfe4-4985-a6f9-6490cde28bc3</serial>
Nov 08 14:00:52 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:00:52 user nova-compute[87365]: </disk>
Nov 08 14:00:52 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:00:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:00:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:00:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:00:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:00:58 user nova-compute[87365]: INFO nova.compute.manager [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Detaching volume 819974d7-9e91-48b4-b2b2-12c5f7af83f6
Nov 08 14:00:58 user nova-compute[87365]: INFO nova.virt.block_device [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attempting to driver detach volume 819974d7-9e91-48b4-b2b2-12c5f7af83f6 from mountpoint /dev/vdb
Nov 08 14:00:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Attempting to detach device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:00:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:00:58 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:58 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:00:58 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:58 user nova-compute[87365]:   <serial>819974d7-9e91-48b4-b2b2-12c5f7af83f6</serial>
Nov 08 14:00:58 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:00:58 user nova-compute[87365]: </disk>
Nov 08 14:00:58 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:00:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config.
Nov 08 14:00:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:00:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:00:58 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:00:58 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:00:58 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:00:58 user nova-compute[87365]:   <serial>819974d7-9e91-48b4-b2b2-12c5f7af83f6</serial>
Nov 08 14:00:58 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:00:58 user nova-compute[87365]: </disk>
Nov 08 14:00:58 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:00:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: INFO nova.compute.manager [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Terminating instance
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-unplugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] No waiting events found dispatching network-vif-unplugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a06efea-7f03-45c1-8e32-5e92732e81cf req-51b9af73-bc8d-49d1-8692-150686aa8069 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-unplugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Instance destroyed successfully.
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid 43d8299d-a8c7-4353-87f1-dcc7a2756c94 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147692656',display_name='tempest-TestVolumeBootPattern-server-1147692656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147692656',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-mppil8pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:59:32Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=43d8299d-a8c7-4353-87f1-dcc7a2756c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "address": "fa:16:3e:3b:27:9b", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98fd8bd5-d8", "ovs_interfaceid": "98fd8bd5-d8b7-4c32-94d4-775a157eae52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_vif [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98fd8bd5-d8, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56084a79-8ad1-4742-b9df-4a32299260b9) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:00 user nova-compute[87365]: INFO os_vif [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:27:9b,bridge_name='br-int',has_traffic_filtering=True,id=98fd8bd5-d8b7-4c32-94d4-775a157eae52,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98fd8bd5-d8')
Nov 08 14:01:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQZxhyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:01:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f402ef-8751-4803-8f7d-f1d4126da68b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:01:00 user nova-compute[87365]: No targets found.
Nov 08 14:01:00 user nova-compute[87365]: iSNS:
Nov 08 14:01:00 user nova-compute[87365]: No targets found.
Nov 08 14:01:00 user nova-compute[87365]: STATIC:
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6
Nov 08 14:01:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:00 user nova-compute[87365]: FIRMWARE:
Nov 08 14:01:00 user nova-compute[87365]: No targets found.
Nov 08 14:01:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:01:00 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:01:00 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[74077afd-296f-43c7-a07c-91ca53f2b2d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c2e7f-894f-4a12-bcff-9e9d9bef27a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4c195a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5509d463-ddf6-4386-ba38-83678777509b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b862ea0-41ba-4783-84d2-413040ae0e6b]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1676f081-0cae-4cdd-93b2-ba87748279e7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f49124-5ac3-4d7d-88fd-5273ec9f67c6]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_13be8acd', '/dev/disk/by-id/scsi-23734373463656662', '/dev/disk/by-id/scsi-1SCST_BIO13be8acd-7474cefbe205db5a') {{(pid=99274) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 14:01:01 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_13be8acd
Nov 08 14:01:01 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23734373463656662
Nov 08 14:01:01 user nova-compute[87365]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO13be8acd-7474cefbe205db5a
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfbab48-f005-4637-8ca2-d2b5a62b36a2]: (4, None) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111f7f4-ce3a-4e3c-9798-21a5f4eaf47e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a216a477-a96f-42a4-a44e-2f7a6d31c4cf]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260]
Nov 08 14:01:01 user nova-compute[87365]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f, portal: 172.16.0.220,3260] successful.
Nov 08 14:01:01 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2bb34ec-d62a-45be-974a-0eca07be774f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2efe5ec-7424-4da5-8120-01afe4eaa896]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (387ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:01:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Deleting instance files /opt/stack/data/nova/instances/43d8299d-a8c7-4353-87f1-dcc7a2756c94_del
Nov 08 14:01:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Deletion of /opt/stack/data/nova/instances/43d8299d-a8c7-4353-87f1-dcc7a2756c94_del complete
Nov 08 14:01:01 user nova-compute[87365]: INFO nova.compute.manager [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 08 14:01:01 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:01 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:01 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Took 0.46 seconds to deallocate network for instance.
Nov 08 14:01:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4ded059-403f-4dbb-a37b-990c6726a308 req-1988ccc3-7ec8-4acc-9696-f03fd2eef201 service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-deleted-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] Acquiring lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] No waiting events found dispatching network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:02 user nova-compute[87365]: WARNING nova.compute.manager [req-674adb0b-5a17-4edd-a795-9d3189a2404a req-d24075e8-d00d-4bd4-821f-999d265f40ab service nova] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Received unexpected event network-vif-plugged-98fd8bd5-d8b7-4c32-94d4-775a157eae52 for instance with vm_state active and task_state deleting.
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:01:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Creating image(s)
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Ensure instance console log exists: /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start _get_guest_xml network_info=[{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e894c11-33a8-4e34-be15-277fb1c6f4cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'serial': 'eae0d4c1-f3c3-4ac8-8919-affeab99faec'}, 'attachment_id': '5f52bb59-8914-4028-beac-038eae3d9993', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:01:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:01:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:01:03 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:03 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:03 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f78fd8-95b1-440c-be80-76d2a2c9f615]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:01:03 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c7d77-5891-4c83-a866-2cbe1a1f0db5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec] added
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d172f-1709-4462-b58b-e4c5058cef2a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093d484-21d6-49de-ab4f-9e049173333f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvwzQTmE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvwzQTmE" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f657a-a17f-4776-95f8-ca0edaef2e42]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvwzQTmE'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff304e-6d87-4254-83c0-0c1880574c93]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: INFO nova.compute.manager [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Took 1.45 seconds to detach 1 volumes for instance.
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 43d8299d-a8c7-4353-87f1-dcc7a2756c94] Deleting volume: d2bb34ec-d62a-45be-974a-0eca07be774f {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178d236-e9b6-401c-ba3f-0a71876fe7aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[788bba97-3f4c-41d5-a4f5-d409d7b4cfc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]
Nov 08 14:01:03 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc02c69-de88-4530-8aa7-9f48d03e9506]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a3f60-48da-4c10-929a-eb543bd3caa6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:03 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d796bd-e22f-433e-8cd5-027ab78ea2b9]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:03 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance 43d8299d-a8c7-4353-87f1-dcc7a2756c94
Nov 08 14:01:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3deed4d1-fde1-4b61-8cad-d598727b3c1c tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "43d8299d-a8c7-4353-87f1-dcc7a2756c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.843s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23537336637666333', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537336637666333', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvwVfqL4qLzUWQBUUD4nfkrkDskpMnlkhIzmkTIWxe1vfMZJQgRizkZHClYYlhrXaEFtwvrzganvNgxa3deH8WFWL5D8JkaZHWuHMKRRlfJtLzLaQVi+6o6N5Cy5go5vg==',key_name='tempest-TestShelveInstance-716194144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:00:36Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:01:04 user nova-compute[87365]:   <uuid>1e894c11-33a8-4e34-be15-277fb1c6f4cd</uuid>
Nov 08 14:01:04 user nova-compute[87365]:   <name>instance-00000022</name>
Nov 08 14:01:04 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:01:04 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:01:04 user nova-compute[87365]:   <metadata>
Nov 08 14:01:04 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:01:04 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:01:04 user nova-compute[87365]:       <nova:name>tempest-TestShelveInstance-server-1018597737</nova:name>
Nov 08 14:01:04 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:01:03</nova:creationTime>
Nov 08 14:01:04 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:01:04 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:01:04 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:01:04 user nova-compute[87365]:       <nova:owner>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:user uuid="b64c48aad8f24a63a24044d7e803b2ee">tempest-TestShelveInstance-1913358462-project-member</nova:user>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:project uuid="0c3523c776dd47cdbae107f85e075ed3">tempest-TestShelveInstance-1913358462</nova:project>
Nov 08 14:01:04 user nova-compute[87365]:       </nova:owner>
Nov 08 14:01:04 user nova-compute[87365]:       <nova:ports>
Nov 08 14:01:04 user nova-compute[87365]:         <nova:port uuid="b73e3d43-0bda-475a-a795-d4891abed15e">
Nov 08 14:01:04 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 14:01:04 user nova-compute[87365]:         </nova:port>
Nov 08 14:01:04 user nova-compute[87365]:       </nova:ports>
Nov 08 14:01:04 user nova-compute[87365]:     </nova:instance>
Nov 08 14:01:04 user nova-compute[87365]:   </metadata>
Nov 08 14:01:04 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:01:04 user nova-compute[87365]:     <system>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="serial">1e894c11-33a8-4e34-be15-277fb1c6f4cd</entry>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="uuid">1e894c11-33a8-4e34-be15-277fb1c6f4cd</entry>
Nov 08 14:01:04 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:01:04 user nova-compute[87365]:     </system>
Nov 08 14:01:04 user nova-compute[87365]:   </sysinfo>
Nov 08 14:01:04 user nova-compute[87365]:   <os>
Nov 08 14:01:04 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:01:04 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:01:04 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:01:04 user nova-compute[87365]:   </os>
Nov 08 14:01:04 user nova-compute[87365]:   <features>
Nov 08 14:01:04 user nova-compute[87365]:     <acpi/>
Nov 08 14:01:04 user nova-compute[87365]:     <apic/>
Nov 08 14:01:04 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:01:04 user nova-compute[87365]:   </features>
Nov 08 14:01:04 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:01:04 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:01:04 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:01:04 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:01:04 user nova-compute[87365]:   </clock>
Nov 08 14:01:04 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:01:04 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:01:04 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:01:04 user nova-compute[87365]:   </cpu>
Nov 08 14:01:04 user nova-compute[87365]:   <devices>
Nov 08 14:01:04 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:01:04 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:01:04 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 14:01:04 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:01:04 user nova-compute[87365]:       <serial>eae0d4c1-f3c3-4ac8-8919-affeab99faec</serial>
Nov 08 14:01:04 user nova-compute[87365]:     </disk>
Nov 08 14:01:04 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:01:04 user nova-compute[87365]:       <mac address="fa:16:3e:14:5b:13"/>
Nov 08 14:01:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:01:04 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:01:04 user nova-compute[87365]:       <target dev="tapb73e3d43-0b"/>
Nov 08 14:01:04 user nova-compute[87365]:     </interface>
Nov 08 14:01:04 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:01:04 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd/console.log" append="off"/>
Nov 08 14:01:04 user nova-compute[87365]:     </serial>
Nov 08 14:01:04 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:01:04 user nova-compute[87365]:     <video>
Nov 08 14:01:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:01:04 user nova-compute[87365]:     </video>
Nov 08 14:01:04 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:01:04 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:01:04 user nova-compute[87365]:     </rng>
Nov 08 14:01:04 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:01:04 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:01:04 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:01:04 user nova-compute[87365]:     </memballoon>
Nov 08 14:01:04 user nova-compute[87365]:   </devices>
Nov 08 14:01:04 user nova-compute[87365]: </domain>
Nov 08 14:01:04 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvwVfqL4qLzUWQBUUD4nfkrkDskpMnlkhIzmkTIWxe1vfMZJQgRizkZHClYYlhrXaEFtwvrzganvNgxa3deH8WFWL5D8JkaZHWuHMKRRlfJtLzLaQVi+6o6N5Cy5go5vg==',key_name='tempest-TestShelveInstance-716194144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:00:36Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG os_vif [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9535095-a8da-51c9-97db-5661d286ec03', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73e3d43-0b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73e3d43-0b, col_values=(('qos', UUID('fb599d21-623f-4850-84eb-6697eef5ad70')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73e3d43-0b, col_values=(('external_ids', {'iface-id': 'b73e3d43-0bda-475a-a795-d4891abed15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:5b:13', 'vm-uuid': '1e894c11-33a8-4e34-be15-277fb1c6f4cd'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:04 user nova-compute[87365]: INFO os_vif [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b')
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:01:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] No VIF found with MAC fa:16:3e:14:5b:13, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:01:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:06 user nova-compute[87365]: WARNING nova.compute.manager [req-956753eb-3bd3-4e79-b6ff-db5d98640178 req-83115800-1751-471c-a4a0-f3c5d9669d41 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state building and task_state spawning.
Nov 08 14:01:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:01:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance spawned successfully.
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:08 user nova-compute[87365]: WARNING nova.compute.manager [req-8a56e36d-a20d-426f-9b82-3e55b70e7d23 req-987b120b-c152-43a7-824a-9e11fda182af service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state building and task_state spawning.
Nov 08 14:01:08 user nova-compute[87365]: INFO nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 08 14:01:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:01:08 user nova-compute[87365]: INFO nova.compute.manager [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Took 33.55 seconds to build instance.
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4417a58-57a8-4b1b-8160-aa7c8895ca1b tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.657s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 31.323s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:08 user nova-compute[87365]: INFO nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 14:01:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:12 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 41b54c9e-bc8b-4f7b-8203-628370bb251a is timed out.
Nov 08 14:01:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully detached device vdb from instance 41b54c9e-bc8b-4f7b-8203-628370bb251a from the live domain config.
Nov 08 14:01:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDqLJIjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:01:12 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79745859-c1de-4103-8f39-32602a41d431]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:01:12 user nova-compute[87365]: No targets found.
Nov 08 14:01:12 user nova-compute[87365]: iSNS:
Nov 08 14:01:12 user nova-compute[87365]: No targets found.
Nov 08 14:01:12 user nova-compute[87365]: STATIC:
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6
Nov 08 14:01:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:12 user nova-compute[87365]: FIRMWARE:
Nov 08 14:01:12 user nova-compute[87365]: No targets found.
Nov 08 14:01:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:01:12 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:01:12 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ddfd10-5a9b-4c6e-8449-895f07405f59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7267d-d597-4001-8151-c7525c7f22c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 (non-flash)
Nov 08 14:01:12 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d0266-0b00-430a-a845-dcf46e3d25fe]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[880faac4-919e-4999-99e0-190086053982]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c206048-292e-4a8b-bc49-e506001253d9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[87591d41-c6fa-4cc3-98f6-10e3ef0c35e9]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b38b53-dcd2-4cbf-b594-eed166693beb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c4a3d9-1a76-4e12-80d1-149822cf1716]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260]
Nov 08 14:01:12 user nova-compute[87365]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3, portal: 172.16.0.220,3260] successful.
Nov 08 14:01:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19ea59b-dfe4-4985-a6f9-6490cde28bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8836b70c-9a3d-4a28-a3cd-faad07be4d91]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== disconnect_volume: return (343ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:01:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:01:13 user nova-compute[87365]: DEBUG nova.objects.instance [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-36616e02-dc93-4f51-8dcd-5a1084986e62 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.948s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 is timed out.
Nov 08 14:01:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config.
Nov 08 14:01:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxSFpLfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:01:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd62889a-9ad6-4ff7-aa5a-147958de4d3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:01:18 user nova-compute[87365]: No targets found.
Nov 08 14:01:18 user nova-compute[87365]: iSNS:
Nov 08 14:01:18 user nova-compute[87365]: No targets found.
Nov 08 14:01:18 user nova-compute[87365]: STATIC:
Nov 08 14:01:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:01:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:01:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:01:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:01:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6
Nov 08 14:01:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:18 user nova-compute[87365]: FIRMWARE:
Nov 08 14:01:18 user nova-compute[87365]: No targets found.
Nov 08 14:01:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:01:18 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:01:18 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e67b8b-eec8-432d-906a-76506e5ece84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7e129-f64f-45e9-a621-1bd9dfd42d6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 (non-flash)
Nov 08 14:01:18 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4d17f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df3db32-efcf-472d-bb1d-139402ac98af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e76e47-3eb1-48eb-ba3f-35d91787316b]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c0c398-085a-4d3f-9b98-55d4cbc9ee91]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:01:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa37aa2-e588-4ec1-89d6-fbbd04af20c4]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff96c8-fa2e-4f94-960e-efc979159d59]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e50a26-4e1d-41c2-9fa1-3706e633f87f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260]
Nov 08 14:01:19 user nova-compute[87365]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6, portal: 172.16.0.220,3260] successful.
Nov 08 14:01:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:819974d7-9e91-48b4-b2b2-12c5f7af83f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb179b-adf6-4a75-9573-cfa383546e4d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== disconnect_volume: return (313ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:01:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9c102e31-7cca-40b6-a310-3a046926bdb4 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:21 user nova-compute[87365]: INFO nova.compute.manager [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Terminating instance
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] During wait destroy, instance disappeared. {{(pid=87365) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 08 14:01:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance destroyed successfully.
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lazy-loading 'resources' on Instance uuid de510f72-fe85-4b4f-8938-ca8976aaff02 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1002097682',display_name='tempest-ServerActionsTestOtherB-server-1002097682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1002097682',id=22,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bR1Z/gck9TEqBe2QnjtIcKK6lRhGeN6qLGcw0BxitMaLsdm0fcs3Q8KmxgEJ6V5FqiW6exC0pDCkzQIZj80Kguqs7mhwrkjQWq9Np9GMcgubzgsULIoiflyVuIJVz/w==',key_name='tempest-keypair-638439755',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='cf4f3ebf487840099cd65d5c708fe710',ramdisk_id='',reservation_id='r-ybivb3gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1469249614',owner_user_name='tempest-ServerActionsTestOtherB-1469249614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='056f4860196044679b260c22a8c83f7f',uuid=de510f72-fe85-4b4f-8938-ca8976aaff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converting VIF {"id": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "address": "fa:16:3e:2f:76:b0", "network": {"id": "03c790c3-e8af-42f3-9ad8-519e0722b84e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1495270355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf4f3ebf487840099cd65d5c708fe710", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1becc56c-05", "ovs_interfaceid": "1becc56c-05fc-4353-9bb9-7ed7ad36cbda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_vif [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1becc56c-05, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:01:21 user nova-compute[87365]: INFO os_vif [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:76:b0,bridge_name='br-int',has_traffic_filtering=True,id=1becc56c-05fc-4353-9bb9-7ed7ad36cbda,network=Network(03c790c3-e8af-42f3-9ad8-519e0722b84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1becc56c-05')
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EKvDyBXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:01:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb3967a-4b70-483e-aa1d-00fb510ba642]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:01:21 user nova-compute[87365]: No targets found.
Nov 08 14:01:21 user nova-compute[87365]: iSNS:
Nov 08 14:01:21 user nova-compute[87365]: No targets found.
Nov 08 14:01:21 user nova-compute[87365]: STATIC:
Nov 08 14:01:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:01:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:01:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:01:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:01:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:01:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:01:21 user nova-compute[87365]: FIRMWARE:
Nov 08 14:01:21 user nova-compute[87365]: No targets found.
Nov 08 14:01:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:01:21 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:01:21 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32ad28e0-7d1d-4caf-89ff-4b668ed6d91e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ecef64-766c-4473-aa79-70c90c2b01fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bcaf0e-d16b-491a-b33a-bfb4d543bdc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:01:21 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:01:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4d15cf0>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] <== disconnect_volume: return (82ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:01:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deletion of /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize failed
Nov 08 14:01:21 user nova-compute[87365]: INFO nova.compute.manager [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Took 0.21 seconds to destroy the instance on the hypervisor.
Nov 08 14:01:21 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:01:21 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:01:22 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:22 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Took 1.01 seconds to deallocate network for instance.
Nov 08 14:01:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-ec683281-4b21-48e8-80fe-8ecdb55447e4 req-4e664dcb-5404-45a8-82f5-fe10d456a871 service nova] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Received event network-vif-deleted-1becc56c-05fc-4353-9bb9-7ed7ad36cbda {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:22 user nova-compute[87365]: INFO nova.compute.manager [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Took 0.16 seconds to detach 1 volumes for instance.
Nov 08 14:01:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:23 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:01:23 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:01:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:23 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Deleted allocations for instance de510f72-fe85-4b4f-8938-ca8976aaff02
Nov 08 14:01:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8c80604e-f17d-4fde-b02c-5d74ce0e71c1 tempest-ServerActionsTestOtherB-1469249614 tempest-ServerActionsTestOtherB-1469249614-project-member] Lock "de510f72-fe85-4b4f-8938-ca8976aaff02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.110s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 3328-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:01:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:32 user nova-compute[87365]: INFO nova.compute.manager [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Unrescuing
Nov 08 14:01:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:01:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:01:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG nova.network.neutron [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'flavor' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:33 user nova-compute[87365]: WARNING nova.compute.manager [req-87a6d3a4-85c6-422c-a681-026e82497737 req-9f595b26-2977-487a-b6db-5ea7d5d2b8f5 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:01:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance destroyed successfully.
Nov 08 14:01:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:35 user nova-compute[87365]: WARNING nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:01:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing instance network info cache due to event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:01:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updated VIF entry in instance network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing instance network info cache due to event network-changed-01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Acquiring lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Acquired lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Refreshing network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updated VIF entry in instance network info cache for port 01452ad0-a98c-47bb-a3b5-3b95526facf2. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG nova.network.neutron [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [{"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3b4f3f79-3e5f-4162-b941-71b0db14109d req-3f4ec6c0-93b7-474f-aa12-daec0a1d5f4f service nova] Releasing lock "refresh_cache-c6f0552a-24eb-4d72-8b92-49cd8da619e9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c4ea184a-f602-472e-8e5c-c0db1bc234c9 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:37 user nova-compute[87365]: WARNING nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:01:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:01:37 user nova-compute[87365]: WARNING nova.compute.manager [req-50c38000-651a-4a71-8d80-def07682db98 req-2b0f43a3-b937-4077-adf5-a67d60c0f8ec service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state rescued and task_state unrescuing.
Nov 08 14:01:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:01:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:01:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:01:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7500MB free_disk=24.180099487304688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:01:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:01:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:01:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:01:46 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [{"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:01:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-368e18ac-eebe-44e9-a2e2-e7059dd82243" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:01:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:01:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:01:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:01:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:01:55 user nova-compute[87365]: INFO nova.compute.manager [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] instance snapshotting
Nov 08 14:01:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Beginning live snapshot process
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json -f qcow2 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e.delta 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e.delta 1073741824" returned: 0 in 0.067s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 14:01:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:01:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 14:01:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=87365) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 14:01:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 14:01:57 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:01:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e.delta /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:01:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e.delta /opt/stack/data/nova/instances/snapshots/tmpr7ni0bs7/45a8b58417af4f7f97d2fb24d8b5746e" returned: 0 in 0.590s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:01:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Snapshot extracted, beginning image upload
Nov 08 14:01:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Snapshot image upload complete
Nov 08 14:02:01 user nova-compute[87365]: INFO nova.compute.manager [None req-df195e47-13aa-4211-9469-d3c14ce5547a tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Took 5.88 seconds to snapshot the instance on the hypervisor.
Nov 08 14:02:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:03 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:02:03 user nova-compute[87365]: INFO nova.compute.claims [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Claim successful on node user
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:02:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.policy [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3e29e071ca349acb9c8f88ff94673f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b55494d4d04b9584f2cd125ebe9b67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:02:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Creating image(s)
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "/opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "/opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Successfully created port: d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.part --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.virt.images [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] fbb1505a-0628-4cfd-83ff-976daeb2a56e was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.part /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.part /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.converted" returned: 0 in 0.429s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:06 user nova-compute[87365]: INFO nova.compute.manager [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Detaching volume 18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:02:06 user nova-compute[87365]: INFO nova.virt.block_device [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Attempting to driver detach volume 18e622e5-001b-4bfe-b75d-b95b12720630 from mountpoint /dev/vdb
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Attempting to detach device vdb from instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:02:06 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:02:06 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:02:06 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:02:06 user nova-compute[87365]:   <serial>18e622e5-001b-4bfe-b75d-b95b12720630</serial>
Nov 08 14:02:06 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:02:06 user nova-compute[87365]: </disk>
Nov 08 14:02:06 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.294s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Successfully detached device vdb from instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 from the persistent domain config.
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:02:06 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:02:06 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:02:06 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:02:06 user nova-compute[87365]:   <serial>18e622e5-001b-4bfe-b75d-b95b12720630</serial>
Nov 08 14:02:06 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:02:06 user nova-compute[87365]: </disk>
Nov 08 14:02:06 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:02:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Successfully updated port: d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquired lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing instance network info cache due to event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] Acquiring lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7,backing_fmt=raw /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7,backing_fmt=raw /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk 1073741824" returned: 0 in 0.054s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "d63052c51a8bc1a18351403938bcd9fbd20781e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Ensure instance console log exists: /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating instance_info_cache with network_info: [{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Releasing lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Instance network_info: |[{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] Acquired lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.neutron [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Start _get_guest_xml network_info=[{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='108c1740ca91573bfc25b5b9ec1937f9',container_format='bare',created_at=2023-11-08T14:01:55Z,direct_url=<?>,disk_format='qcow2',id=fbb1505a-0628-4cfd-83ff-976daeb2a56e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-45544960',owner='a5b55494d4d04b9584f2cd125ebe9b67',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T14:02:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'fbb1505a-0628-4cfd-83ff-976daeb2a56e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:02:07 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:07 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='108c1740ca91573bfc25b5b9ec1937f9',container_format='bare',created_at=2023-11-08T14:01:55Z,direct_url=<?>,disk_format='qcow2',id=fbb1505a-0628-4cfd-83ff-976daeb2a56e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-45544960',owner='a5b55494d4d04b9584f2cd125ebe9b67',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T14:02:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1111874855',display_name='tempest-TestStampPattern-server-1111874855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1111874855',id=36,image_ref='fbb1505a-0628-4cfd-83ff-976daeb2a56e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-mddkuvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='41b54c9e-bc8b-4f7b-8203-628370bb251a',image_min_disk='1',image_min_ram='0',image_owner_id='a5b55494d4d04b9584f2cd125ebe9b67',image_owner_project_name='tempest-TestStampPattern-135387725',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-135387725-project-member',image_user_id='c3e29e071ca349acb9c8f88ff94673f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:04Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=cd66e505-8e3f-4462-953f-3911d748eb69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'pci_devices' on Instance uuid cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:02:07 user nova-compute[87365]:   <uuid>cd66e505-8e3f-4462-953f-3911d748eb69</uuid>
Nov 08 14:02:07 user nova-compute[87365]:   <name>instance-00000024</name>
Nov 08 14:02:07 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:02:07 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:02:07 user nova-compute[87365]:   <metadata>
Nov 08 14:02:07 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:02:07 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:name>tempest-TestStampPattern-server-1111874855</nova:name>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:02:07</nova:creationTime>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:02:07 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:02:07 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:owner>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:user uuid="c3e29e071ca349acb9c8f88ff94673f8">tempest-TestStampPattern-135387725-project-member</nova:user>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:project uuid="a5b55494d4d04b9584f2cd125ebe9b67">tempest-TestStampPattern-135387725</nova:project>
Nov 08 14:02:07 user nova-compute[87365]:       </nova:owner>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:root type="image" uuid="fbb1505a-0628-4cfd-83ff-976daeb2a56e"/>
Nov 08 14:02:07 user nova-compute[87365]:       <nova:ports>
Nov 08 14:02:07 user nova-compute[87365]:         <nova:port uuid="d9534cb0-3733-4da4-94f9-6f95688c756c">
Nov 08 14:02:07 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 14:02:07 user nova-compute[87365]:         </nova:port>
Nov 08 14:02:07 user nova-compute[87365]:       </nova:ports>
Nov 08 14:02:07 user nova-compute[87365]:     </nova:instance>
Nov 08 14:02:07 user nova-compute[87365]:   </metadata>
Nov 08 14:02:07 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:02:07 user nova-compute[87365]:     <system>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="serial">cd66e505-8e3f-4462-953f-3911d748eb69</entry>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="uuid">cd66e505-8e3f-4462-953f-3911d748eb69</entry>
Nov 08 14:02:07 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:02:07 user nova-compute[87365]:     </system>
Nov 08 14:02:07 user nova-compute[87365]:   </sysinfo>
Nov 08 14:02:07 user nova-compute[87365]:   <os>
Nov 08 14:02:07 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:02:07 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:02:07 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:02:07 user nova-compute[87365]:   </os>
Nov 08 14:02:07 user nova-compute[87365]:   <features>
Nov 08 14:02:07 user nova-compute[87365]:     <acpi/>
Nov 08 14:02:07 user nova-compute[87365]:     <apic/>
Nov 08 14:02:07 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:02:07 user nova-compute[87365]:   </features>
Nov 08 14:02:07 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:02:07 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:02:07 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:02:07 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:02:07 user nova-compute[87365]:   </clock>
Nov 08 14:02:07 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:02:07 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:02:07 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:02:07 user nova-compute[87365]:   </cpu>
Nov 08 14:02:07 user nova-compute[87365]:   <devices>
Nov 08 14:02:07 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:02:07 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:02:07 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk"/>
Nov 08 14:02:07 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:02:07 user nova-compute[87365]:     </disk>
Nov 08 14:02:07 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:02:07 user nova-compute[87365]:       <mac address="fa:16:3e:f1:b6:8d"/>
Nov 08 14:02:07 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:02:07 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:02:07 user nova-compute[87365]:       <target dev="tapd9534cb0-37"/>
Nov 08 14:02:07 user nova-compute[87365]:     </interface>
Nov 08 14:02:07 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:02:07 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/console.log" append="off"/>
Nov 08 14:02:07 user nova-compute[87365]:     </serial>
Nov 08 14:02:07 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:02:07 user nova-compute[87365]:     <video>
Nov 08 14:02:07 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:02:07 user nova-compute[87365]:     </video>
Nov 08 14:02:07 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:02:07 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:02:07 user nova-compute[87365]:     </rng>
Nov 08 14:02:07 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:02:07 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:02:07 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:02:07 user nova-compute[87365]:     </memballoon>
Nov 08 14:02:07 user nova-compute[87365]:   </devices>
Nov 08 14:02:07 user nova-compute[87365]: </domain>
Nov 08 14:02:07 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1111874855',display_name='tempest-TestStampPattern-server-1111874855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1111874855',id=36,image_ref='fbb1505a-0628-4cfd-83ff-976daeb2a56e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-mddkuvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='41b54c9e-bc8b-4f7b-8203-628370bb251a',image_min_disk='1',image_min_ram='0',image_owner_id='a5b55494d4d04b9584f2cd125ebe9b67',image_owner_project_name='tempest-TestStampPattern-135387725',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-135387725-project-member',image_user_id='c3e29e071ca349acb9c8f88ff94673f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:04Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=cd66e505-8e3f-4462-953f-3911d748eb69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG os_vif [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9004ae1a-1de4-5c75-837f-45c1d824b342', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9534cb0-37, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9534cb0-37, col_values=(('qos', UUID('2f448c20-1feb-4940-90ad-c3bf9ab841bd')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9534cb0-37, col_values=(('external_ids', {'iface-id': 'd9534cb0-3733-4da4-94f9-6f95688c756c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:b6:8d', 'vm-uuid': 'cd66e505-8e3f-4462-953f-3911d748eb69'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:07 user nova-compute[87365]: INFO os_vif [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37')
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:02:07 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No VIF found with MAC fa:16:3e:f1:b6:8d, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:02:08 user nova-compute[87365]: DEBUG nova.network.neutron [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updated VIF entry in instance network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:08 user nova-compute[87365]: DEBUG nova.network.neutron [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating instance_info_cache with network_info: [{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4343b889-bf40-4b44-9769-c43bad30705c req-c6147cef-fdaf-4541-ac74-1742c1ff42f5 service nova] Releasing lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] No waiting events found dispatching network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:09 user nova-compute[87365]: WARNING nova.compute.manager [req-f82b30d6-41ba-459a-bbf7-ef2f02cb735b req-a97e74bd-897d-4585-80c5-12cf907e8ab7 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received unexpected event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c for instance with vm_state building and task_state spawning.
Nov 08 14:02:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] No waiting events found dispatching network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:11 user nova-compute[87365]: WARNING nova.compute.manager [req-0ed5e175-ce6a-4597-9851-3dcf6bd95ec3 req-7ee8dd8a-003e-48a0-b0b9-55162cff8bf4 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received unexpected event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c for instance with vm_state building and task_state spawning.
Nov 08 14:02:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:02:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Instance spawned successfully.
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:11 user nova-compute[87365]: INFO nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 08 14:02:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:02:12 user nova-compute[87365]: INFO nova.compute.manager [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Took 8.33 seconds to build instance.
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f44f1618-d301-46b9-95db-44e6f55005c9 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.462s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:12 user nova-compute[87365]: INFO nova.compute.manager [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attaching volume 7bf54292-51af-4daf-bfae-2c25206ab577 to /dev/vdb
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.utils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[96507ea5-17dc-4035-907a-6ad5752bf1d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ec687c-d6cf-478b-9033-8734f6af1b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ae38d-3c5a-4542-88d7-0c15c390b9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada63ad-dcf1-4a55-bc2c-0bf2a9fc8f47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:02:12 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:02:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7635ec-a7d0-4bed-93d1-d4a75cbd1ab6]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG os_brick.utils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating existing volume attachment record: a89503ed-71c0-4f70-a412-c838a2890ff0 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:02:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:02:18 user nova-compute[87365]: INFO nova.compute.claims [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Claim successful on node user
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:02:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.policy [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e83098542a5b412ca87f6ee5a6c2b499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a39c014336e54dcfa0d31ac286cc62d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:02:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Creating image(s)
Nov 08 14:02:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "/opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "/opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk 1073741824" returned: 0 in 0.056s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Successfully created port: 4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Cannot resize image /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Ensure instance console log exists: /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Successfully updated port: 4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquired lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-changed-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Refreshing instance network info cache due to event network-changed-4ea00190-d2ee-4a0f-9e96-e86739cb4a95. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] Acquiring lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.neutron [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updating instance_info_cache with network_info: [{"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Releasing lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Instance network_info: |[{"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] Acquired lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Refreshing network info cache for port 4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Start _get_guest_xml network_info=[{"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:02:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499586924',display_name='tempest-VolumesSnapshotTestJSON-instance-499586924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499586924',id=37,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5dsPJrayJA20zbr8Cq/L09cWiamNRn4dEiy/ZoG6l8CRz3aScIH/3qlrMc+/NgsJ1FZ6zp4f5lFMa/OV0cEC6GmLcZjRymVTHZS+EUXSNvzlwvk626bo9HoK3nCNUpiw==',key_name='tempest-keypair-1836760181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-3itrc0qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=9cbcde5a-dfe9-42b3-853a-f3b25e9acd30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:02:21 user nova-compute[87365]:   <uuid>9cbcde5a-dfe9-42b3-853a-f3b25e9acd30</uuid>
Nov 08 14:02:21 user nova-compute[87365]:   <name>instance-00000025</name>
Nov 08 14:02:21 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:02:21 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:02:21 user nova-compute[87365]:   <metadata>
Nov 08 14:02:21 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:02:21 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-499586924</nova:name>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:02:21</nova:creationTime>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:02:21 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:02:21 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:owner>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:user uuid="e83098542a5b412ca87f6ee5a6c2b499">tempest-VolumesSnapshotTestJSON-1602758470-project-member</nova:user>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:project uuid="a39c014336e54dcfa0d31ac286cc62d4">tempest-VolumesSnapshotTestJSON-1602758470</nova:project>
Nov 08 14:02:21 user nova-compute[87365]:       </nova:owner>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:02:21 user nova-compute[87365]:       <nova:ports>
Nov 08 14:02:21 user nova-compute[87365]:         <nova:port uuid="4ea00190-d2ee-4a0f-9e96-e86739cb4a95">
Nov 08 14:02:21 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 14:02:21 user nova-compute[87365]:         </nova:port>
Nov 08 14:02:21 user nova-compute[87365]:       </nova:ports>
Nov 08 14:02:21 user nova-compute[87365]:     </nova:instance>
Nov 08 14:02:21 user nova-compute[87365]:   </metadata>
Nov 08 14:02:21 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:02:21 user nova-compute[87365]:     <system>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="serial">9cbcde5a-dfe9-42b3-853a-f3b25e9acd30</entry>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="uuid">9cbcde5a-dfe9-42b3-853a-f3b25e9acd30</entry>
Nov 08 14:02:21 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:02:21 user nova-compute[87365]:     </system>
Nov 08 14:02:21 user nova-compute[87365]:   </sysinfo>
Nov 08 14:02:21 user nova-compute[87365]:   <os>
Nov 08 14:02:21 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:02:21 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:02:21 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:02:21 user nova-compute[87365]:   </os>
Nov 08 14:02:21 user nova-compute[87365]:   <features>
Nov 08 14:02:21 user nova-compute[87365]:     <acpi/>
Nov 08 14:02:21 user nova-compute[87365]:     <apic/>
Nov 08 14:02:21 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:02:21 user nova-compute[87365]:   </features>
Nov 08 14:02:21 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:02:21 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:02:21 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:02:21 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:02:21 user nova-compute[87365]:   </clock>
Nov 08 14:02:21 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:02:21 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:02:21 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:02:21 user nova-compute[87365]:   </cpu>
Nov 08 14:02:21 user nova-compute[87365]:   <devices>
Nov 08 14:02:21 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:02:21 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:02:21 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk"/>
Nov 08 14:02:21 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:02:21 user nova-compute[87365]:     </disk>
Nov 08 14:02:21 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:02:21 user nova-compute[87365]:       <mac address="fa:16:3e:4a:3a:e5"/>
Nov 08 14:02:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:02:21 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:02:21 user nova-compute[87365]:       <target dev="tap4ea00190-d2"/>
Nov 08 14:02:21 user nova-compute[87365]:     </interface>
Nov 08 14:02:21 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:02:21 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/console.log" append="off"/>
Nov 08 14:02:21 user nova-compute[87365]:     </serial>
Nov 08 14:02:21 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:02:21 user nova-compute[87365]:     <video>
Nov 08 14:02:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:02:21 user nova-compute[87365]:     </video>
Nov 08 14:02:21 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:02:21 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:02:21 user nova-compute[87365]:     </rng>
Nov 08 14:02:21 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:02:21 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:02:21 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:02:21 user nova-compute[87365]:     </memballoon>
Nov 08 14:02:21 user nova-compute[87365]:   </devices>
Nov 08 14:02:21 user nova-compute[87365]: </domain>
Nov 08 14:02:21 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499586924',display_name='tempest-VolumesSnapshotTestJSON-instance-499586924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499586924',id=37,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5dsPJrayJA20zbr8Cq/L09cWiamNRn4dEiy/ZoG6l8CRz3aScIH/3qlrMc+/NgsJ1FZ6zp4f5lFMa/OV0cEC6GmLcZjRymVTHZS+EUXSNvzlwvk626bo9HoK3nCNUpiw==',key_name='tempest-keypair-1836760181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-3itrc0qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=9cbcde5a-dfe9-42b3-853a-f3b25e9acd30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG os_vif [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6f0bb4b-56f4-59fb-998f-3aff685a0883', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:21 user nova-compute[87365]: INFO nova.compute.manager [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Terminating instance
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea00190-d2, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ea00190-d2, col_values=(('qos', UUID('271fd8ac-d5a6-43f6-957f-218658cd472a')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ea00190-d2, col_values=(('external_ids', {'iface-id': '4ea00190-d2ee-4a0f-9e96-e86739cb4a95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:3a:e5', 'vm-uuid': '9cbcde5a-dfe9-42b3-853a-f3b25e9acd30'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: INFO os_vif [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2')
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:02:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No VIF found with MAC fa:16:3e:4a:3a:e5, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-40a2977f-d98a-4544-a09c-8b21ae86d023 req-ee384518-a7dc-4074-81d7-8c42a7a20aa5 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updated VIF entry in instance network info cache for port 4ea00190-d2ee-4a0f-9e96-e86739cb4a95. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updating instance_info_cache with network_info: [{"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6021b4ea-541c-4a43-9265-29a3ac471b9a req-aed1ab4f-8f83-409d-8567-d068f970dc8e service nova] Releasing lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Instance destroyed successfully.
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid 3c7723ce-8e93-40d9-94f8-35767b220322 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1675383101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1675383101',id=30,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:58:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-s5nxjo0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:00:36Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=3c7723ce-8e93-40d9-94f8-35767b220322,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "efd44520-0a16-40c2-b155-409224cec32f", "address": "fa:16:3e:04:e8:0d", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefd44520-0a", "ovs_interfaceid": "efd44520-0a16-40c2-b155-409224cec32f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_vif [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefd44520-0a, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ef3908-3825-46f5-b874-536deebc897b) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: INFO os_vif [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:0d,bridge_name='br-int',has_traffic_filtering=True,id=efd44520-0a16-40c2-b155-409224cec32f,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefd44520-0a')
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfNIzJPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:23 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58bbf0-2f4d-4d84-ab36-cb69045b9df6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:02:23 user nova-compute[87365]: No targets found.
Nov 08 14:02:23 user nova-compute[87365]: iSNS:
Nov 08 14:02:23 user nova-compute[87365]: No targets found.
Nov 08 14:02:23 user nova-compute[87365]: STATIC:
Nov 08 14:02:23 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:02:23 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:23 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:23 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:02:23 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:23 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:23 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e
Nov 08 14:02:23 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:23 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:23 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:02:23 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:23 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:23 user nova-compute[87365]: FIRMWARE:
Nov 08 14:02:23 user nova-compute[87365]: No targets found.
Nov 08 14:02:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:02:23 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:02:23 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3daeb89-9bc6-4618-955a-41471e5d5a6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ac6e9-38ea-40ac-a928-6cea19b6e85a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:02:23 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4f93eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26810b8-7d60-4cf6-83af-8f4053419884]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd80925a-5290-4f34-aa17-b729fa6e423b]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef799483-9448-4dfd-9af2-61e7b462b2d7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf30218-e21d-4f03-8a3e-01628f8031b0]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0efea-7a02-4c64-aea2-f6fbf715de9a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c660335-aca1-4b2b-8a21-3a8fb88c82fd]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260]
Nov 08 14:02:23 user nova-compute[87365]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e, portal: 172.16.0.220,3260] successful.
Nov 08 14:02:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef23e653-42db-4a4a-9c18-4e5766cc4b2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1555b-8d2b-49c2-ac3a-f91ee5f077f5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== disconnect_volume: return (421ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:02:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Deleting instance files /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322_del
Nov 08 14:02:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Deletion of /opt/stack/data/nova/instances/3c7723ce-8e93-40d9-94f8-35767b220322_del complete
Nov 08 14:02:23 user nova-compute[87365]: INFO nova.compute.manager [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Took 2.21 seconds to destroy the instance on the hypervisor.
Nov 08 14:02:23 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:02:23 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: WARNING nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state deleting.
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: WARNING nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state deleting.
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: WARNING nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state deleting.
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-unplugged-efd44520-0a16-40c2-b155-409224cec32f for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Acquiring lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] Lock "3c7723ce-8e93-40d9-94f8-35767b220322-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] No waiting events found dispatching network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: WARNING nova.compute.manager [req-44c9b692-daee-4414-a4db-cb768b302b41 req-bfcff2b5-0254-4817-9d77-70dee3885635 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received unexpected event network-vif-plugged-efd44520-0a16-40c2-b155-409224cec32f for instance with vm_state active and task_state deleting.
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] No waiting events found dispatching network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:24 user nova-compute[87365]: WARNING nova.compute.manager [req-f553e5fa-a52b-4c8c-8804-7aabb42b9e49 req-3f200b5f-98ba-4541-a4b7-8162e63301a1 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received unexpected event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 for instance with vm_state building and task_state spawning.
Nov 08 14:02:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:25 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:25 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Took 1.09 seconds to deallocate network for instance.
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:02:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Instance spawned successfully.
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] No waiting events found dispatching network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:26 user nova-compute[87365]: WARNING nova.compute.manager [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received unexpected event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 for instance with vm_state building and task_state spawning.
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-4028b1cb-031c-4f63-85b0-929f3883e5a8 req-59e8b827-193c-4f61-9d62-10cb87691f02 service nova] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Received event network-vif-deleted-efd44520-0a16-40c2-b155-409224cec32f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing instance network info cache due to event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:26 user nova-compute[87365]: INFO nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 08 14:02:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:02:26 user nova-compute[87365]: INFO nova.compute.manager [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Took 7.61 seconds to build instance.
Nov 08 14:02:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-cf1f6eb2-3081-4877-8f14-40462c707732 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.721s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG nova.network.neutron [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updated VIF entry in instance network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG nova.network.neutron [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-100f5cdc-e36d-4a48-983a-6e8d8fb804a8 req-b37acec9-3d43-4d1b-8bc4-94dd4dd409a9 service nova] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:27 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 is timed out.
Nov 08 14:02:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Successfully detached device vdb from instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 from the live domain config.
Nov 08 14:02:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwjyAnOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:27 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae7ef8d-664e-435c-8d03-bd5460a4c096]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:02:27 user nova-compute[87365]: No targets found.
Nov 08 14:02:27 user nova-compute[87365]: iSNS:
Nov 08 14:02:27 user nova-compute[87365]: No targets found.
Nov 08 14:02:27 user nova-compute[87365]: STATIC:
Nov 08 14:02:27 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:02:27 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:27 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:27 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:02:27 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:27 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:27 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630
Nov 08 14:02:27 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:27 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:27 user nova-compute[87365]: FIRMWARE:
Nov 08 14:02:27 user nova-compute[87365]: No targets found.
Nov 08 14:02:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:02:27 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:02:27 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da2d930-3525-4c82-aba7-2c997078496e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a262d8-0ef1-46f3-bde5-22c2f645ebc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:27 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:02:27 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:27 user nova-compute[87365]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 (non-flash)
Nov 08 14:02:27 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf84c2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc144915-b855-4be3-8298-5e31a25ac8a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d2704-ac62-42a4-babb-a73499720667]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b46e9ea-83f7-44bd-99a1-6e846c5f2eef]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5a9e0a-115d-4374-b314-8dca9b0f236c]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e510300-71a6-47a5-aadf-722e2f923b7c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b89e51a-7b2d-4ba8-b9b5-1b3c89cf9b33]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260]
Nov 08 14:02:27 user nova-compute[87365]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630, portal: 172.16.0.220,3260] successful.
Nov 08 14:02:27 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e622e5-001b-4bfe-b75d-b95b12720630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba46a374-44e1-4637-8f0e-e2dc319febbc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] <== disconnect_volume: return (357ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:27 user nova-compute[87365]: INFO nova.compute.manager [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Shelve offloading
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing instance network info cache due to event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:28 user nova-compute[87365]: WARNING nova.compute.manager [req-dd7a1dc8-a3c0-44f1-a708-24142065fcab req-7ec7d179-af52-4816-9b05-e83f0eada08e service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state shelving.
Nov 08 14:02:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance destroyed successfully.
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'flavor' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-82fcee5d-2e3c-4406-9e35-ec79d546ba1a tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.399s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updated VIF entry in instance network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-93962293-a97a-4cc9-bad5-6724efe60cdb req-f8d781ec-2c59-4843-a5d7-3484b2c39eb0 service nova] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:30 user nova-compute[87365]: WARNING nova.compute.manager [req-4b6a6817-65c7-40f9-a86c-6766fd3c3e38 req-1d445ecb-4381-4482-8aa9-1bcbbaf9e3d8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state shelving.
Nov 08 14:02:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance destroyed successfully.
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'resources' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvwVfqL4qLzUWQBUUD4nfkrkDskpMnlkhIzmkTIWxe1vfMZJQgRizkZHClYYlhrXaEFtwvrzganvNgxa3deH8WFWL5D8JkaZHWuHMKRRlfJtLzLaQVi+6o6N5Cy5go5vg==',key_name='tempest-TestShelveInstance-716194144',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:01:08Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_vif [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73e3d43-0b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb599d21-623f-4850-84eb-6697eef5ad70) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:30 user nova-compute[87365]: INFO os_vif [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b')
Nov 08 14:02:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:30 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50794f9-021d-4d85-89e7-515ee034cde7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:02:30 user nova-compute[87365]: No targets found.
Nov 08 14:02:30 user nova-compute[87365]: iSNS:
Nov 08 14:02:30 user nova-compute[87365]: No targets found.
Nov 08 14:02:30 user nova-compute[87365]: STATIC:
Nov 08 14:02:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:02:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:02:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:02:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:02:30 user nova-compute[87365]: FIRMWARE:
Nov 08 14:02:30 user nova-compute[87365]: No targets found.
Nov 08 14:02:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:02:30 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:02:30 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cdd21b-2657-4e72-aa5f-621c2e7e33fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce8b11-dd95-4113-8cf5-7a3fd86d8441]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:31 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:31 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:31 user nova-compute[87365]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:02:31 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4fd52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40fc8b5-6a51-423e-aeea-6cba9dd654d0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4811e-dc50-45f5-a499-7118a9146b25]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb5c6e-7bf8-4278-afee-bbb77e66ada3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b564e-0c03-44d8-88bf-dec44b8e8115]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aeddbe-aa14-495c-a583-3c43adb256fa]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0499b1-7244-4b3f-b9cc-2020ab4f2733]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]
Nov 08 14:02:31 user nova-compute[87365]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.
Nov 08 14:02:31 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fa8400-5463-4d1e-841d-6257f7d824a6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== disconnect_volume: return (369ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:02:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deleting instance files /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd_del
Nov 08 14:02:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deletion of /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd_del complete
Nov 08 14:02:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:32 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Deleted allocations for instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd
Nov 08 14:02:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing instance network info cache due to event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:32 user nova-compute[87365]: DEBUG nova.objects.base [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Object Instance<1e894c11-33a8-4e34-be15-277fb1c6f4cd> lazy-loaded attributes: resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updated VIF entry in instance network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": null, "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1122b20-0980-4111-91b0-54336d1713f2 req-e08c02e2-3de2-4b61-ad1d-1597ee2eaad8 service nova] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5b8d2778-106f-442d-9e52-27d8dce73faf tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.171s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:39 user nova-compute[87365]: INFO nova.compute.manager [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Shelving
Nov 08 14:02:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:39 user nova-compute[87365]: WARNING nova.compute.manager [req-6494ad8c-1028-4c65-83bd-42eb14257eeb req-daf29d49-84b3-4910-85cb-865c0b5572d3 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state active and task_state shelving.
Nov 08 14:02:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance destroyed successfully.
Nov 08 14:02:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Beginning cold snapshot process
Nov 08 14:02:40 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:02:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk /opt/stack/data/nova/instances/snapshots/tmpjws72rjf/3c1fb03e361746269f99d15424728635 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:02:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk /opt/stack/data/nova/instances/snapshots/tmpjws72rjf/3c1fb03e361746269f99d15424728635" returned: 0 in 1.112s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Snapshot extracted, beginning image upload
Nov 08 14:02:41 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG nova.compute.manager [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:42 user nova-compute[87365]: WARNING nova.compute.manager [req-78bd1b42-7dba-4dd3-bcb7-56e5bd6608da req-2e66f6c0-e635-4def-9069-78600f94714a service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:02:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:44 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Snapshot image upload complete
Nov 08 14:02:44 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:44 user nova-compute[87365]: INFO nova.compute.manager [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Shelve offloading
Nov 08 14:02:44 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance destroyed successfully.
Nov 08 14:02:44 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance destroyed successfully.
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'resources' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDUBGcqq2BmB+uPwsl58TRaHqM5TXEFZDnV/bYelqjCl/To2qZAK7iYTr1UKVoSxiLBjZBywxCl8mIvUJGEkgD94gW66mSxLnqbfxjph/rfE+ePgPqHzAH0pwjxbEC1BA==',key_name='tempest-keypair-1486094982',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T14:02:44.449690',shelved_host='user',shelved_image_id='85bcde0a-61d7-4bfe-b7d1-69d2899a1583'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:02:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG os_vif [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing instance network info cache due to event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG nova.network.neutron [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1757412-0b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79e218fa-5689-428a-be09-beb29d5ea02e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:45 user nova-compute[87365]: INFO os_vif [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b')
Nov 08 14:02:45 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Deleting instance files /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257_del
Nov 08 14:02:45 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Deletion of /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257_del complete
Nov 08 14:02:46 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Deleted allocations for instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG nova.objects.base [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<8d77f463-f4c6-44a1-94ba-ce5b5e04b257> lazy-loaded attributes: resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updated VIF entry in instance network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb1757412-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7492MB free_disk=23.930503845214844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-62dff466-89ab-4dec-bd38-380de434430f req-b528ef55-e9c1-454e-8f1b-3c7d45ca9760 service nova] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.949s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.653s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:02:47 user nova-compute[87365]: INFO nova.compute.claims [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Claim successful on node user
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d6eb4bdc-fecd-482e-95c1-f3814e40b842 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.874s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.670s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:02:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.policy [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c6f0552a-24eb-4d72-8b92-49cd8da619e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3c7723ce-8e93-40d9-94f8-35767b220322 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cd66e505-8e3f-4462-953f-3911d748eb69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:02:47 user nova-compute[87365]: INFO nova.virt.block_device [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Booting with volume 2acfc132-d0c7-415a-9acc-f40bd8af5a30 at /dev/vda
Nov 08 14:02:47 user nova-compute[87365]: DEBUG os_brick.utils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c384de0-638b-4472-bdda-0d00bc979ef3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d443dc-aa2b-4b9b-ad3a-f288c0966f93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624baa2-bfcb-4b57-880b-a47c6ada313a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84d42e1-eee9-4af7-8990-c050145b6174]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:02:48 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bdf033-2e1c-4965-ac83-364e95f481a2]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG os_brick.utils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating existing volume attachment record: c23779dd-aacc-4922-976b-a3891af52cf3 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Successfully created port: ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Successfully updated port: ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-changed-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Refreshing instance network info cache due to event network-changed-ac7f756d-68e9-4e55-b348-f861229f7f63. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] Acquiring lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating instance_info_cache with network_info: [{"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Instance network_info: |[{"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] Acquired lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Refreshing network info cache for port ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:02:50 user nova-compute[87365]: INFO nova.compute.manager [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 3c7723ce-8e93-40d9-94f8-35767b220322] Took 25.69 seconds to detach 1 volumes for instance.
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEMcOnJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:02:51 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:02:51 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:02:51 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[89619d16-77a3-45f1-bdf4-8d552b10202c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:02:51 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updated VIF entry in instance network info cache for port ac7f756d-68e9-4e55-b348-f861229f7f63. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating instance_info_cache with network_info: [{"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cb8f3600-db0a-4d69-895f-f838d0c56ac1 req-bef04f0a-68ed-4722-b361-72956f29a16b service nova] Releasing lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ca9a8-ad66-4388-8ed5-0e76d7180109]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577] added
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5acc7-fed6-4397-8b5c-a8d831afa565]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b01b0-1411-44ba-b2a3-6f0d158ddd68]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zEMcOnJD {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zEMcOnJD" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[24289ba4-1c3a-45fc-8039-8d24988fded3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zEMcOnJD'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a114d-4a57-401c-afd5-5469c58f0c2c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebc2276-0773-4563-8dad-c4d1aaeddd46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Deleted allocations for instance 3c7723ce-8e93-40d9-94f8-35767b220322
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ccaf96-c177-42ca-8e98-4374ab84e0ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260]
Nov 08 14:02:51 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260] successful.
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updating instance_info_cache with network_info: [{"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb94b7-98a1-4b5c-9fd4-8fbeb8690547]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8d56a3ea-784a-445c-86f9-f6cdd1e096bc tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "3c7723ce-8e93-40d9-94f8-35767b220322" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 29.757s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8beee8-b3cc-4425-af48-61cefb8b7b9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:51 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:02:51 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:02:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c3a3e-3879-43a0-9382-5b0b628a42f0]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:02:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEMcOnJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26266363034633532', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266363034633532', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:02:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:02:52 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:02:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:02:52 user nova-compute[87365]:   <serial>7bf54292-51af-4daf-bfae-2c25206ab577</serial>
Nov 08 14:02:52 user nova-compute[87365]: </disk>
Nov 08 14:02:52 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:02:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No VIF found with MAC fa:16:3e:65:d0:12, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:02:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8029b238-19f6-4da0-8868-b06c9eaaa669 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.035s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:57 user nova-compute[87365]: INFO nova.compute.manager [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Detaching volume 7bf54292-51af-4daf-bfae-2c25206ab577
Nov 08 14:02:57 user nova-compute[87365]: INFO nova.virt.block_device [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attempting to driver detach volume 7bf54292-51af-4daf-bfae-2c25206ab577 from mountpoint /dev/vdb
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Attempting to detach device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:02:57 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:02:57 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:02:57 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:02:57 user nova-compute[87365]:   <serial>7bf54292-51af-4daf-bfae-2c25206ab577</serial>
Nov 08 14:02:57 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:02:57 user nova-compute[87365]: </disk>
Nov 08 14:02:57 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:02:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config.
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:02:57 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:02:57 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:02:57 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:02:57 user nova-compute[87365]:   <serial>7bf54292-51af-4daf-bfae-2c25206ab577</serial>
Nov 08 14:02:57 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:02:57 user nova-compute[87365]: </disk>
Nov 08 14:02:57 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:57 user nova-compute[87365]: INFO nova.compute.manager [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Terminating instance
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-601de57f-dbe8-4c77-985f-4ca8c21d1cb8 req-b3b6a3cc-fc02-4d7a-8619-858477d2948e service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-unplugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Instance destroyed successfully.
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.objects.instance [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lazy-loading 'resources' on Instance uuid c6f0552a-24eb-4d72-8b92-49cd8da619e9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1986300821',display_name='tempest-ServerStableDeviceRescueTest-server-1986300821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1986300821',id=29,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHQNoEXYhLnfLfy+FmAgNjJ2gsqF4fOUbmjMgcGaXVrAjwSL5VYkLGh3IhSaslDmUe8724n0XH5oXkcKCzB2fA/Z8o8a7GI704gvT0QLsFUSCzkh+pIQ8xSeLNDiXWDWA==',key_name='tempest-keypair-2030627838',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:59:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f05f6965be17462d8c1447838b4437f6',ramdisk_id='',reservation_id='r-ov72t729',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-542592970',owner_user_name='tempest-ServerStableDeviceRescueTest-542592970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aed7fbc5c4f4736a2d5ac621c413c76',uuid=c6f0552a-24eb-4d72-8b92-49cd8da619e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converting VIF {"id": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "address": "fa:16:3e:b5:5b:ad", "network": {"id": "16334f17-d5ea-407f-a8de-d6f30d353a5a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1830963722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f05f6965be17462d8c1447838b4437f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01452ad0-a9", "ovs_interfaceid": "01452ad0-a98c-47bb-a3b5-3b95526facf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG os_vif [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01452ad0-a9, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2a89bb3-991d-49e3-aaaf-2e9d81ec2bc3) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:02:58 user nova-compute[87365]: INFO os_vif [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:5b:ad,bridge_name='br-int',has_traffic_filtering=True,id=01452ad0-a98c-47bb-a3b5-3b95526facf2,network=Network(16334f17-d5ea-407f-a8de-d6f30d353a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01452ad0-a9')
Nov 08 14:02:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Deleting instance files /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9_del
Nov 08 14:02:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Deletion of /opt/stack/data/nova/instances/c6f0552a-24eb-4d72-8b92-49cd8da619e9_del complete
Nov 08 14:02:58 user nova-compute[87365]: INFO nova.compute.manager [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 14:02:58 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:02:58 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:02:59 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Took 0.92 seconds to deallocate network for instance.
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-8c298970-8bbc-41ce-95be-0840ea8a788f req-7bb31531-4cb6-4928-9dc6-727a0c230e8a service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-deleted-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:59 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Deleted allocations for instance c6f0552a-24eb-4d72-8b92-49cd8da619e9
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-971bc191-b1bb-4e79-afbb-eb7a191cae72 tempest-ServerStableDeviceRescueTest-542592970 tempest-ServerStableDeviceRescueTest-542592970-project-member] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] Acquiring lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] Lock "c6f0552a-24eb-4d72-8b92-49cd8da619e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:02:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] No waiting events found dispatching network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:02:59 user nova-compute[87365]: WARNING nova.compute.manager [req-881c3481-7c59-49c1-8e0d-e7859bb302c5 req-2341a6fb-4025-4f46-b63b-e170e58547f9 service nova] [instance: c6f0552a-24eb-4d72-8b92-49cd8da619e9] Received unexpected event network-vif-plugged-01452ad0-a98c-47bb-a3b5-3b95526facf2 for instance with vm_state deleted and task_state None.
Nov 08 14:03:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:03:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.compute.manager [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Terminating instance
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-unplugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] No waiting events found dispatching network-vif-unplugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-d311e2ff-868e-4581-8275-86990b4987e3 req-4f5b8ea9-808a-4430-b2c9-82e0295028f1 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-unplugged-946a583c-d041-4f91-a541-02e87ab1ebbe for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Instance destroyed successfully.
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-271822386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-271822386',id=26,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-6tg02682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:54:55Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "946a583c-d041-4f91-a541-02e87ab1ebbe", "address": "fa:16:3e:38:ea:af", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap946a583c-d0", "ovs_interfaceid": "946a583c-d041-4f91-a541-02e87ab1ebbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_vif [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap946a583c-d0, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Creating image(s)
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Ensure instance console log exists: /opt/stack/data/nova/instances/c4220fe0-5f26-42c7-bd5b-c17c8852ceb9/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Start _get_guest_xml network_info=[{"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYOmbQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4220fe0-5f26-42c7-bd5b-c17c8852ceb9', 'attached_at': '', 'detached_at': '', 'volume_id': '2acfc132-d0c7-415a-9acc-f40bd8af5a30', 'serial': '2acfc132-d0c7-415a-9acc-f40bd8af5a30'}, 'attachment_id': 'c23779dd-aacc-4922-976b-a3891af52cf3', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6488f9df-627c-418a-8e7b-e81a202e1229) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:03:13 user nova-compute[87365]: INFO os_vif [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ea:af,bridge_name='br-int',has_traffic_filtering=True,id=946a583c-d041-4f91-a541-02e87ab1ebbe,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap946a583c-d0')
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Deleting instance files /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427_del
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Deletion of /opt/stack/data/nova/instances/bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427_del complete
Nov 08 14:03:13 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:03:13 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYOmbQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:03:13 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:03:13 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:03:13 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:13 user nova-compute[87365]: INFO nova.compute.manager [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f6caa-63a2-4002-a1c6-dc84ecd16735]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:03:13 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa87f9-df52-49cb-8dfb-e5f5d1b82e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30] added
Nov 08 14:03:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bd56f2-95db-440b-a23b-3f08a990bf18]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b60c018-150f-4da5-a54f-c9114436f35d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRYOmbQk {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRYOmbQk" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14873b3b-343b-4fc1-8597-0ca074891411]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRYOmbQk'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[230a5c04-ef5b-40a0-80e4-8158725d7a9b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee45445-9dd5-4343-a896-b41c1b4d8c0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef98e1-b94f-4786-88e5-f9639e7ab0f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260]
Nov 08 14:03:14 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260] successful.
Nov 08 14:03:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[243dceaa-0492-4041-aa4b-8dcaf6fc49eb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff9ac13-10a8-4be7-a652-83483861efa4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:03:14 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f7491-a73e-47c2-90b0-6f1af800d973]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYOmbQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:03:14 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Took 0.52 seconds to deallocate network for instance.
Nov 08 14:03:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-994eaaca-1161-47b7-b31f-72d1fdbd2e35 req-b8322efe-0ac0-4e45-80cb-5601f10237a8 service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-deleted-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:14 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Deleted allocations for instance bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427
Nov 08 14:03:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f23757d0-86e9-4a37-adc0-3e8ceffb7120 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.760s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23833626565316131', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833626565316131', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-430803022',display_name='tempest-TestVolumeBootPattern-volume-backed-server-430803022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-430803022',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrucU/zBexje0ipFJEOZ2ZWG932XyIwE9wm38QH9BUjZpwjQy0OXfg3KWkUXDjVr2D+WlSi6ePoVcSf1PGTCH7MCoeQsbOWKcHzybPmB7/VP6gqegn6Xv2UCe/5CI6aA==',key_name='tempest-keypair-1654793552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-4mi0qcop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=c4220fe0-5f26-42c7-bd5b-c17c8852ceb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.objects.instance [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:03:15 user nova-compute[87365]:   <uuid>c4220fe0-5f26-42c7-bd5b-c17c8852ceb9</uuid>
Nov 08 14:03:15 user nova-compute[87365]:   <name>instance-00000026</name>
Nov 08 14:03:15 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:03:15 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:03:15 user nova-compute[87365]:   <metadata>
Nov 08 14:03:15 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:03:15 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:03:15 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-430803022</nova:name>
Nov 08 14:03:15 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:03:13</nova:creationTime>
Nov 08 14:03:15 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:03:15 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:03:15 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:03:15 user nova-compute[87365]:       <nova:owner>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 14:03:15 user nova-compute[87365]:       </nova:owner>
Nov 08 14:03:15 user nova-compute[87365]:       <nova:ports>
Nov 08 14:03:15 user nova-compute[87365]:         <nova:port uuid="ac7f756d-68e9-4e55-b348-f861229f7f63">
Nov 08 14:03:15 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 14:03:15 user nova-compute[87365]:         </nova:port>
Nov 08 14:03:15 user nova-compute[87365]:       </nova:ports>
Nov 08 14:03:15 user nova-compute[87365]:     </nova:instance>
Nov 08 14:03:15 user nova-compute[87365]:   </metadata>
Nov 08 14:03:15 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:03:15 user nova-compute[87365]:     <system>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="serial">c4220fe0-5f26-42c7-bd5b-c17c8852ceb9</entry>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="uuid">c4220fe0-5f26-42c7-bd5b-c17c8852ceb9</entry>
Nov 08 14:03:15 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:03:15 user nova-compute[87365]:     </system>
Nov 08 14:03:15 user nova-compute[87365]:   </sysinfo>
Nov 08 14:03:15 user nova-compute[87365]:   <os>
Nov 08 14:03:15 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:03:15 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:03:15 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:03:15 user nova-compute[87365]:   </os>
Nov 08 14:03:15 user nova-compute[87365]:   <features>
Nov 08 14:03:15 user nova-compute[87365]:     <acpi/>
Nov 08 14:03:15 user nova-compute[87365]:     <apic/>
Nov 08 14:03:15 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:03:15 user nova-compute[87365]:   </features>
Nov 08 14:03:15 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:03:15 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:03:15 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:03:15 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:03:15 user nova-compute[87365]:   </clock>
Nov 08 14:03:15 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:03:15 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:03:15 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:03:15 user nova-compute[87365]:   </cpu>
Nov 08 14:03:15 user nova-compute[87365]:   <devices>
Nov 08 14:03:15 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:03:15 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:03:15 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 14:03:15 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:03:15 user nova-compute[87365]:       <serial>2acfc132-d0c7-415a-9acc-f40bd8af5a30</serial>
Nov 08 14:03:15 user nova-compute[87365]:     </disk>
Nov 08 14:03:15 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:03:15 user nova-compute[87365]:       <mac address="fa:16:3e:84:a6:e3"/>
Nov 08 14:03:15 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:03:15 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:03:15 user nova-compute[87365]:       <target dev="tapac7f756d-68"/>
Nov 08 14:03:15 user nova-compute[87365]:     </interface>
Nov 08 14:03:15 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:03:15 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/c4220fe0-5f26-42c7-bd5b-c17c8852ceb9/console.log" append="off"/>
Nov 08 14:03:15 user nova-compute[87365]:     </serial>
Nov 08 14:03:15 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:03:15 user nova-compute[87365]:     <video>
Nov 08 14:03:15 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:03:15 user nova-compute[87365]:     </video>
Nov 08 14:03:15 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:03:15 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:03:15 user nova-compute[87365]:     </rng>
Nov 08 14:03:15 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:03:15 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:03:15 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:03:15 user nova-compute[87365]:     </memballoon>
Nov 08 14:03:15 user nova-compute[87365]:   </devices>
Nov 08 14:03:15 user nova-compute[87365]: </domain>
Nov 08 14:03:15 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-430803022',display_name='tempest-TestVolumeBootPattern-volume-backed-server-430803022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-430803022',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrucU/zBexje0ipFJEOZ2ZWG932XyIwE9wm38QH9BUjZpwjQy0OXfg3KWkUXDjVr2D+WlSi6ePoVcSf1PGTCH7MCoeQsbOWKcHzybPmB7/VP6gqegn6Xv2UCe/5CI6aA==',key_name='tempest-keypair-1654793552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-4mi0qcop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=c4220fe0-5f26-42c7-bd5b-c17c8852ceb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG os_vif [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5ae7b14-5081-576a-902b-415af1d5fa42', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac7f756d-68, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac7f756d-68, col_values=(('qos', UUID('ee0b0963-bac8-46ca-8779-8583b8d0b8a8')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac7f756d-68, col_values=(('external_ids', {'iface-id': 'ac7f756d-68e9-4e55-b348-f861229f7f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:a6:e3', 'vm-uuid': 'c4220fe0-5f26-42c7-bd5b-c17c8852ceb9'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:15 user nova-compute[87365]: INFO os_vif [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68')
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:84:a6:e3, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] Acquiring lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] Lock "bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:15 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] No waiting events found dispatching network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:03:15 user nova-compute[87365]: WARNING nova.compute.manager [req-c9b8f65f-6291-405b-aef7-caae792cf95e req-f5780b04-d5a4-4588-b836-b531ac5388ba service nova] [instance: bd61f7d1-cf65-4dd3-8d2e-4cfa79c62427] Received unexpected event network-vif-plugged-946a583c-d041-4f91-a541-02e87ab1ebbe for instance with vm_state deleted and task_state None.
Nov 08 14:03:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] No waiting events found dispatching network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:03:17 user nova-compute[87365]: WARNING nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received unexpected event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 for instance with vm_state building and task_state spawning.
Nov 08 14:03:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] No waiting events found dispatching network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:03:17 user nova-compute[87365]: WARNING nova.compute.manager [req-0b8a5537-1fea-44ea-bf2e-b66ed7f32f4c req-2d31a70d-11c0-40ab-ae42-630af6f072d8 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received unexpected event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 for instance with vm_state building and task_state spawning.
Nov 08 14:03:17 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 is timed out.
Nov 08 14:03:17 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config.
Nov 08 14:03:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zEMcOnJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:03:17 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb358d-0227-4992-ac7d-887362816b2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:03:17 user nova-compute[87365]: No targets found.
Nov 08 14:03:17 user nova-compute[87365]: iSNS:
Nov 08 14:03:17 user nova-compute[87365]: No targets found.
Nov 08 14:03:17 user nova-compute[87365]: STATIC:
Nov 08 14:03:17 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577
Nov 08 14:03:17 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:03:17 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:03:17 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:03:17 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:03:17 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:03:17 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:03:17 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:03:17 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:03:17 user nova-compute[87365]: FIRMWARE:
Nov 08 14:03:17 user nova-compute[87365]: No targets found.
Nov 08 14:03:17 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:03:17 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:03:17 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5835920-dd8a-4980-b139-562be2f272bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a24b63d-f469-4870-ba3d-8e2578193c66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:17 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:17 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:03:17 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:03:17 user nova-compute[87365]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 (non-flash)
Nov 08 14:03:17 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:03:17 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf81b45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b92813d-64fd-4402-827f-e9a0caea2c08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194f947-262f-4086-9cf4-8e74deb99d98]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c5517a-f523-4b52-a2e4-250b3b1a7098]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:03:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba2767-4834-4695-aa96-b4c76e732f61]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc28f7-6998-4dab-87d4-c3656d243b10]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8741f4-0e0d-424e-a6ce-ef43b95d191e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260]
Nov 08 14:03:18 user nova-compute[87365]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577, portal: 172.16.0.220,3260] successful.
Nov 08 14:03:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bf54292-51af-4daf-bfae-2c25206ab577 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6424a314-967c-45c3-a90d-bf09a6a2c00f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== disconnect_volume: return (308ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:03:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Instance spawned successfully.
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:03:18 user nova-compute[87365]: INFO nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 08 14:03:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:03:19 user nova-compute[87365]: INFO nova.compute.manager [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Took 32.57 seconds to build instance.
Nov 08 14:03:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-07167274-edea-4bc7-8fd5-b7eabd254880 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.717s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:19 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:03:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2533bbf8-8296-4364-8303-ea3a7c02f648 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:30 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:03:45 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=24.203083038330078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 368e18ac-eebe-44e9-a2e2-e7059dd82243 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cd66e505-8e3f-4462-953f-3911d748eb69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:03:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:03:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing instance network info cache due to event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] Acquiring lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] Acquired lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.network.neutron [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.network.neutron [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updated VIF entry in instance network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.network.neutron [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating instance_info_cache with network_info: [{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-84e79049-2b42-4e3d-a64b-74dac6458759 req-38dd5c71-6c35-419a-9d16-4fe7f9774446 service nova] Releasing lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:03:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:57 user nova-compute[87365]: INFO nova.compute.manager [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Attaching volume 3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 to /dev/vdb
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.utils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977b7c4-96c2-4d4d-ae42-966afd102faa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcd8d9-4761-4760-a033-14b2a7ebf7e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bcdbf4-9a41-4cf1-99e8-9b6055ef931a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[68150b75-fc1a-4d2c-899f-15faaaaf566e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:03:57 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:03:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[487daf1f-fc6b-441d-87a0-ebaa9687741f]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG os_brick.utils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:03:57 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating existing volume attachment record: 2c03fb30-f88a-41da-a5f6-83eee28c86f1 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:03:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:03:59 user nova-compute[87365]: INFO nova.compute.manager [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attaching volume 1da6f7c3-2cd3-4e73-845b-4417278110e0 to /dev/vdb
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.utils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e2d32-54c4-4558-842a-01696fe764e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8c223-4b51-4037-a91c-68c9a315c357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[97669caa-e30f-4695-ab75-3ffe6f1949b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081f387-7694-4e76-8d3c-260eb4c366a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:03:59 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:03:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc64cc1-ab0d-417b-949e-fb3af9932537]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG os_brick.utils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:03:59 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating existing volume attachment record: 2886e0bf-7e00-4e03-8903-31fbcd567f85 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:04:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:03 user nova-compute[87365]: INFO nova.compute.manager [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Terminating instance
Nov 08 14:04:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-dfd46b1c-efa5-4fde-8c8f-f3244ac5a308 req-0e17fb75-4b2d-419b-b792-adf9aed52147 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-unplugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:04:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Instance destroyed successfully.
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid 368e18ac-eebe-44e9-a2e2-e7059dd82243 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1917528633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1917528633',id=15,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-0sqwha4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:51:13Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=368e18ac-eebe-44e9-a2e2-e7059dd82243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "address": "fa:16:3e:2b:0f:e0", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f403498-6a", "ovs_interfaceid": "2f403498-6ab4-4d7e-bac9-ac06aef9a6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_vif [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f403498-6a, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe93eb47-cf99-4289-ba82-5bf514b04427) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:04 user nova-compute[87365]: INFO os_vif [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:e0,bridge_name='br-int',has_traffic_filtering=True,id=2f403498-6ab4-4d7e-bac9-ac06aef9a6db,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f403498-6a')
Nov 08 14:04:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgknSalT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:04 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3d757-64a8-422d-b91b-be242664175f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:04:04 user nova-compute[87365]: No targets found.
Nov 08 14:04:04 user nova-compute[87365]: iSNS:
Nov 08 14:04:04 user nova-compute[87365]: No targets found.
Nov 08 14:04:04 user nova-compute[87365]: STATIC:
Nov 08 14:04:04 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e
Nov 08 14:04:04 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:04 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:04 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:04:04 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:04 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:04 user nova-compute[87365]: FIRMWARE:
Nov 08 14:04:04 user nova-compute[87365]: No targets found.
Nov 08 14:04:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:04:04 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:04:04 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d606b61-a02a-4ad0-b3c4-dbf8ce5802f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eedd9d-003a-47fe-8e24-6f4f0a30aaca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:04:04 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e (non-flash)
Nov 08 14:04:04 user nova-compute[87365]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4e19480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e'): ({'sdh'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Removing single pathed devices sdh {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5589e0-7229-439f-8897-4cc0e4b39ab6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08adca-946c-4c4e-b48f-e58667a5cf1e]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Flushing IO for device /dev/sdh {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[41863d4f-1846-44c8-b8d2-fdf2d7d00876]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.064s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[df937fb3-45b8-4b06-98c4-8ad35bc3f56c]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] SCSI volumes sdh have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d385da3-d688-4ceb-a291-bb8ceb8d9e03]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8298fe-9248-4854-9b6e-455c16d5e7af]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260]
Nov 08 14:04:04 user nova-compute[87365]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:04 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06a464b2-b817-4838-b7ae-a029d6a2b60e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19cb9dd-80c7-4c1d-97fc-9d923c889b9e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] <== disconnect_volume: return (367ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:04:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Deleting instance files /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243_del
Nov 08 14:04:05 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Deletion of /opt/stack/data/nova/instances/368e18ac-eebe-44e9-a2e2-e7059dd82243_del complete
Nov 08 14:04:05 user nova-compute[87365]: INFO nova.compute.manager [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 08 14:04:05 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:04:05 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:05 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Took 0.72 seconds to deallocate network for instance.
Nov 08 14:04:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] Acquiring lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] No waiting events found dispatching network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:06 user nova-compute[87365]: WARNING nova.compute.manager [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received unexpected event network-vif-plugged-2f403498-6ab4-4d7e-bac9-ac06aef9a6db for instance with vm_state active and task_state deleting.
Nov 08 14:04:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-abafd942-f5d1-4a15-832a-dbdb16948029 req-6283100b-507b-4ac4-b77f-aa972bf02bd3 service nova] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Received event network-vif-deleted-2f403498-6ab4-4d7e-bac9-ac06aef9a6db {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:06 user nova-compute[87365]: INFO nova.compute.manager [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: 368e18ac-eebe-44e9-a2e2-e7059dd82243] Took 1.00 seconds to detach 1 volumes for instance.
Nov 08 14:04:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:07 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:07 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:07 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Deleted allocations for instance 368e18ac-eebe-44e9-a2e2-e7059dd82243
Nov 08 14:04:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b19e964e-a0fb-4d8e-bb66-e6b566b5a166 tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "368e18ac-eebe-44e9-a2e2-e7059dd82243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.602s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-changed-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Refreshing instance network info cache due to event network-changed-4ea00190-d2ee-4a0f-9e96-e86739cb4a95. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] Acquiring lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] Acquired lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Refreshing network info cache for port 4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:09 user nova-compute[87365]: DEBUG nova.objects.instance [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:09 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Ignoring supplied device name: /dev/vdb
Nov 08 14:04:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:10 user nova-compute[87365]: INFO nova.compute.manager [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Attaching volume 1f0d508d-c0ce-4ca4-800d-b5a209204a9f to /dev/vdb
Nov 08 14:04:10 user nova-compute[87365]: DEBUG nova.network.neutron [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updated VIF entry in instance network info cache for port 4ea00190-d2ee-4a0f-9e96-e86739cb4a95. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG nova.network.neutron [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updating instance_info_cache with network_info: [{"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f27e6ffa-5479-438e-a326-4d94c98bc399 req-456b557f-acdd-439c-8487-fb3ed7c37e08 service nova] Releasing lock "refresh_cache-9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9793ce-a8a4-4f81-9edb-ba135d07b28f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd2ac3-7e82-479b-b989-2d5adf89a800]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[481993b1-2220-4caa-af7e-b8366ab7552e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fca64-fda7-437f-87f4-1f7fd98d2fed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:04:10 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:04:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2edfb3-6d29-4f2d-8855-9e3b1f556883]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:10 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updating existing volume attachment record: 640a1550-ccf1-49e7-b555-3a16a3b2aa35 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:04:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:20 user nova-compute[87365]: INFO nova.compute.manager [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Unshelving
Nov 08 14:04:20 user nova-compute[87365]: INFO nova.virt.block_device [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Booting with volume eae0d4c1-f3c3-4ac8-8919-affeab99faec at /dev/vda
Nov 08 14:04:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbcqzYhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:23 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:23 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:23 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2552ba-ba30-4d2c-b1f1-874edda16bd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:04:23 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75d8e4-db89-40f2-8016-9125cb66552c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0] added
Nov 08 14:04:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c8d6b-183d-46e6-892f-d7026b06a4e9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab9b71-7634-483b-aa1b-12832e3a6caf]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbcqzYhn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbcqzYhn" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[50927bed-356a-41d8-9a35-fa9ce4aae618]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbcqzYhn'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.166s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ff1a82-511d-4bb0-9b0d-95c82844a225]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4441b56c-fa89-4120-bba3-2368b4680ffc]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:23 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f40d26-4056-44e8-bf4f-4d084eeb60d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260]
Nov 08 14:04:24 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c9b80-2b0b-47e9-abfb-61b57b90ae69]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ef92f-37a0-4dad-9e85-93edb55a7817]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:24 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:24 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[95197a3e-8f99-4a9a-bcbb-645b9db1b273]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbcqzYhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.utils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2533f7-06fc-4e4d-b936-9eb587b0420d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8249794c-4f39-4bfa-8103-ec341cdd760f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42cc0ca-fe21-44a4-895a-967b8f5709e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7051d96-8809-43f4-bd57-46ebe8a72129]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:04:24 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:04:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8d03b2-8e5d-432d-97f6-9781576397b9]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG os_brick.utils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating existing volume attachment record: 8458711a-6ada-4edf-a506-3e345cc5608b {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:04:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23566666238366430', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566666238366430', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:04:25 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:25 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:04:25 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:25 user nova-compute[87365]:   <serial>1da6f7c3-2cd3-4e73-845b-4417278110e0</serial>
Nov 08 14:04:25 user nova-compute[87365]: </disk>
Nov 08 14:04:25 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] No VIF found with MAC fa:16:3e:65:d0:12, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:04:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKgmabdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:32 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:32 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:32 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba06937-bce3-4700-a73f-ade457d33cab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:04:32 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19055244-b600-4699-8283-2453d26d4160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19] added
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f11d970-92a2-47de-aa4f-7a1b8f6bf1c3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a1bf7-70fc-4bec-a59b-2348565bc7cd]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKgmabdp {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKgmabdp" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[02080f55-f0a8-4229-b226-c3ac57e33c8d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKgmabdp'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f016c2ff-d865-4b2a-a5b2-8c27f1dcd15b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da2b146-b916-46dd-8915-2f16a2561222]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[16579986-be79-486d-be1f-b1eb2dc33aa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260]
Nov 08 14:04:32 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7d24f5-3165-4c0f-b25f-d6d641c502d9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb361fce-b483-4a2d-af84-409843df9a2d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:32 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c3787f-3e86-40ea-8bf2-c2c102df73b8]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-704d5157-642e-488d-880a-c8b338ca9824 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.430s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKgmabdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26138653433373434', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138653433373434', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:04:33 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:33 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:04:33 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:33 user nova-compute[87365]:   <serial>3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19</serial>
Nov 08 14:04:33 user nova-compute[87365]: </disk>
Nov 08 14:04:33 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] No VIF found with MAC fa:16:3e:f1:b6:8d, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f413e16d-0dfc-4c30-94d6-0c18a5076232 tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.572s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWqgciuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:34 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:34 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:34 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:04:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8c870-46b3-42dd-90c8-102a47584777]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:04:35 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ecf93a-f08c-41e6-9453-0f516822ff67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f] added
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2584ac6-d55e-41a5-9cf6-92ad64fe9b6e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9797b44-9b00-4ab7-8a35-b185f9caf2df]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWqgciuT {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWqgciuT" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a79dd9-d2af-4280-ae11-5cd00971cc4b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWqgciuT'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6d9d8-764b-44e6-b001-10877061121e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96825d5-d5d4-4634-8145-c983a1a36724]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a14ed-228c-4788-8566-e7633c08336c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260]
Nov 08 14:04:35 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42c002-d173-4687-994d-69a247658deb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21aa3ea-61a6-48ce-8add-e151b2ff31e6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:35 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4496b-3121-481c-b39b-7624a5067e53]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:35 user nova-compute[87365]: INFO nova.compute.manager [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Unshelving
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:04:35 user nova-compute[87365]: INFO nova.compute.claims [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Claim successful on node user
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:35 user nova-compute[87365]: INFO nova.compute.manager [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Detaching volume 1da6f7c3-2cd3-4e73-845b-4417278110e0
Nov 08 14:04:35 user nova-compute[87365]: INFO nova.virt.block_device [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attempting to driver detach volume 1da6f7c3-2cd3-4e73-845b-4417278110e0 from mountpoint /dev/vdb
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Attempting to detach device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:04:35 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:35 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:04:35 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:35 user nova-compute[87365]:   <serial>1da6f7c3-2cd3-4e73-845b-4417278110e0</serial>
Nov 08 14:04:35 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:04:35 user nova-compute[87365]: </disk>
Nov 08 14:04:35 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:04:35 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the persistent domain config.
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:04:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:04:35 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:35 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:04:35 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:35 user nova-compute[87365]:   <serial>1da6f7c3-2cd3-4e73-845b-4417278110e0</serial>
Nov 08 14:04:35 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:04:35 user nova-compute[87365]: </disk>
Nov 08 14:04:35 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:36 user nova-compute[87365]: INFO nova.network.neutron [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating port b1757412-0b82-41e5-b5ce-f344e9d9f47e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWqgciuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23138356438383738', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138356438383738', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.objects.instance [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:04:36 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:36 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:04:36 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:36 user nova-compute[87365]:   <serial>1f0d508d-c0ce-4ca4-800d-b5a209204a9f</serial>
Nov 08 14:04:36 user nova-compute[87365]: </disk>
Nov 08 14:04:36 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] No VIF found with MAC fa:16:3e:4a:3a:e5, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-bb116ddc-eb11-440b-8a4b-80aa30492914 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.895s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing instance network info cache due to event network-changed-b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] Acquiring lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:37 user nova-compute[87365]: INFO nova.compute.manager [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Detaching volume 3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19
Nov 08 14:04:37 user nova-compute[87365]: INFO nova.virt.block_device [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Attempting to driver detach volume 3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 from mountpoint /dev/vdb
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Attempting to detach device vdb from instance cd66e505-8e3f-4462-953f-3911d748eb69 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:04:37 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:37 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:04:37 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:37 user nova-compute[87365]:   <serial>3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19</serial>
Nov 08 14:04:37 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:04:37 user nova-compute[87365]: </disk>
Nov 08 14:04:37 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:04:37 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully detached device vdb from instance cd66e505-8e3f-4462-953f-3911d748eb69 from the persistent domain config.
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd66e505-8e3f-4462-953f-3911d748eb69 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:04:37 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:37 user nova-compute[87365]:   <source dev="/dev/sdd"/>
Nov 08 14:04:37 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:04:37 user nova-compute[87365]:   <serial>3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19</serial>
Nov 08 14:04:37 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:04:37 user nova-compute[87365]: </disk>
Nov 08 14:04:37 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:04:37 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Creating image(s)
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] Acquired lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Refreshing network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG nova.objects.base [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<8d77f463-f4c6-44a1-94ba-ce5b5e04b257> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-changed-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Refreshing instance network info cache due to event network-changed-ac7f756d-68e9-4e55-b348-f861229f7f63. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] Acquiring lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] Acquired lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Refreshing network info cache for port ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.part --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.virt.images [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] 85bcde0a-61d7-4bfe-b7d1-69d2899a1583 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:04:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.part /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.part /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.converted" returned: 0 in 0.545s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updated VIF entry in instance network info cache for port b1757412-0b82-41e5-b5ce-f344e9d9f47e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5d54c391-603e-43b0-a6f8-3b60af6882b4 req-fe930a82-ac2d-494e-adfa-f80be44a2e92 service nova] Releasing lock "refresh_cache-8d77f463-f4c6-44a1-94ba-ce5b5e04b257" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.130s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updated VIF entry in instance network info cache for port ac7f756d-68e9-4e55-b348-f861229f7f63. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG nova.network.neutron [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating instance_info_cache with network_info: [{"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02bd1b77-bd72-4434-8339-c8b519681377 req-76b11b7e-c74f-4479-81fe-9c523235ece3 service nova] Releasing lock "refresh_cache-c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json" returned: 0 in 0.254s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5,backing_fmt=raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5,backing_fmt=raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk 1073741824" returned: 0 in 0.065s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "c18fbfa53e2b68887176511dae94fa848e67d0f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'migration_context' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG nova.objects.base [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<8d77f463-f4c6-44a1-94ba-ce5b5e04b257> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Rebasing disk image.
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 -F raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 -F raw /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk" returned: 0 in 2.768s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Ensure instance console log exists: /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start _get_guest_xml network_info=[{"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a7022d928ce43887844e3712ad355a92',container_format='bare',created_at=2023-11-08T14:02:39Z,direct_url=<?>,disk_format='qcow2',id=85bcde0a-61d7-4bfe-b7d1-69d2899a1583,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-740798959-shelved',owner='8f9d5da6823541c282006a7871e50ca8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T14:02:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:04:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a7022d928ce43887844e3712ad355a92',container_format='bare',created_at=2023-11-08T14:02:39Z,direct_url=<?>,disk_format='qcow2',id=85bcde0a-61d7-4bfe-b7d1-69d2899a1583,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-740798959-shelved',owner='8f9d5da6823541c282006a7871e50ca8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T14:02:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.objects.base [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<8d77f463-f4c6-44a1-94ba-ce5b5e04b257> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='85bcde0a-61d7-4bfe-b7d1-69d2899a1583',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1486094982',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T14:02:44.449690',shelved_host='user',shelved_image_id='85bcde0a-61d7-4bfe-b7d1-69d2899a1583'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.objects.base [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Object Instance<8d77f463-f4c6-44a1-94ba-ce5b5e04b257> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:04:43 user nova-compute[87365]:   <uuid>8d77f463-f4c6-44a1-94ba-ce5b5e04b257</uuid>
Nov 08 14:04:43 user nova-compute[87365]:   <name>instance-00000023</name>
Nov 08 14:04:43 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:04:43 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:04:43 user nova-compute[87365]:   <metadata>
Nov 08 14:04:43 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:04:43 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-740798959</nova:name>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:04:43</nova:creationTime>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:04:43 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:04:43 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:owner>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:user uuid="3ad4efa600524c27a048bd565bf1852c">tempest-AttachVolumeShelveTestJSON-1136658600-project-member</nova:user>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:project uuid="8f9d5da6823541c282006a7871e50ca8">tempest-AttachVolumeShelveTestJSON-1136658600</nova:project>
Nov 08 14:04:43 user nova-compute[87365]:       </nova:owner>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:root type="image" uuid="85bcde0a-61d7-4bfe-b7d1-69d2899a1583"/>
Nov 08 14:04:43 user nova-compute[87365]:       <nova:ports>
Nov 08 14:04:43 user nova-compute[87365]:         <nova:port uuid="b1757412-0b82-41e5-b5ce-f344e9d9f47e">
Nov 08 14:04:43 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 14:04:43 user nova-compute[87365]:         </nova:port>
Nov 08 14:04:43 user nova-compute[87365]:       </nova:ports>
Nov 08 14:04:43 user nova-compute[87365]:     </nova:instance>
Nov 08 14:04:43 user nova-compute[87365]:   </metadata>
Nov 08 14:04:43 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:04:43 user nova-compute[87365]:     <system>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="serial">8d77f463-f4c6-44a1-94ba-ce5b5e04b257</entry>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="uuid">8d77f463-f4c6-44a1-94ba-ce5b5e04b257</entry>
Nov 08 14:04:43 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:04:43 user nova-compute[87365]:     </system>
Nov 08 14:04:43 user nova-compute[87365]:   </sysinfo>
Nov 08 14:04:43 user nova-compute[87365]:   <os>
Nov 08 14:04:43 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:04:43 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:04:43 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:04:43 user nova-compute[87365]:   </os>
Nov 08 14:04:43 user nova-compute[87365]:   <features>
Nov 08 14:04:43 user nova-compute[87365]:     <acpi/>
Nov 08 14:04:43 user nova-compute[87365]:     <apic/>
Nov 08 14:04:43 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:04:43 user nova-compute[87365]:   </features>
Nov 08 14:04:43 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:04:43 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:04:43 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:04:43 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:04:43 user nova-compute[87365]:   </clock>
Nov 08 14:04:43 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:04:43 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:04:43 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:04:43 user nova-compute[87365]:   </cpu>
Nov 08 14:04:43 user nova-compute[87365]:   <devices>
Nov 08 14:04:43 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:04:43 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:04:43 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk"/>
Nov 08 14:04:43 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:04:43 user nova-compute[87365]:     </disk>
Nov 08 14:04:43 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:04:43 user nova-compute[87365]:       <mac address="fa:16:3e:96:f1:3b"/>
Nov 08 14:04:43 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:04:43 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:04:43 user nova-compute[87365]:       <target dev="tapb1757412-0b"/>
Nov 08 14:04:43 user nova-compute[87365]:     </interface>
Nov 08 14:04:43 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:04:43 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/console.log" append="off"/>
Nov 08 14:04:43 user nova-compute[87365]:     </serial>
Nov 08 14:04:43 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:04:43 user nova-compute[87365]:     <video>
Nov 08 14:04:43 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:04:43 user nova-compute[87365]:     </video>
Nov 08 14:04:43 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:04:43 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:04:43 user nova-compute[87365]:     </rng>
Nov 08 14:04:43 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:04:43 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:04:43 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:04:43 user nova-compute[87365]:     </memballoon>
Nov 08 14:04:43 user nova-compute[87365]:   </devices>
Nov 08 14:04:43 user nova-compute[87365]: </domain>
Nov 08 14:04:43 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='85bcde0a-61d7-4bfe-b7d1-69d2899a1583',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1486094982',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:00:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member',shelved_at='2023-11-08T14:02:44.449690',shelved_host='user',shelved_image_id='85bcde0a-61d7-4bfe-b7d1-69d2899a1583'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG os_vif [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e284a37-47c1-5f16-97ea-73c01a361f89', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1757412-0b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1757412-0b, col_values=(('qos', UUID('5e5abd0b-388f-436e-8916-a3b8e66834c1')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1757412-0b, col_values=(('external_ids', {'iface-id': 'b1757412-0b82-41e5-b5ce-f344e9d9f47e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f1:3b', 'vm-uuid': '8d77f463-f4c6-44a1-94ba-ce5b5e04b257'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:43 user nova-compute[87365]: INFO os_vif [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b')
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] No VIF found with MAC fa:16:3e:96:f1:3b, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:45 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:45 user nova-compute[87365]: WARNING nova.compute.manager [req-0a0dc42d-b2fd-437e-86d2-bcd73fd30e0b req-a9980506-1b01-4678-86db-c4ce09a1119e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 14:04:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:04:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance spawned successfully.
Nov 08 14:04:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG nova.compute.manager [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:47 user nova-compute[87365]: WARNING nova.compute.manager [req-40479dd2-e731-4537-9db4-da3067313114 req-5dfe1631-f9f5-483e-a9c2-163fce4f1e11 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b240311a-8313-4923-aea1-d315ba421361 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.714s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7886MB free_disk=24.069080352783203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance cd66e505-8e3f-4462-953f-3911d748eb69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.950s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 1 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:04:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deletion of /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize failed
Nov 08 14:04:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.objects.instance [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.objects.instance [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:04:51 user nova-compute[87365]: INFO nova.compute.claims [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Claim successful on node user
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:04:51 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:52 user nova-compute[87365]: INFO nova.network.neutron [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating port b73e3d43-0bda-475a-a795-d4891abed15e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing instance network info cache due to event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:04:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Creating image(s)
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Ensure instance console log exists: /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start _get_guest_xml network_info=[{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e894c11-33a8-4e34-be15-277fb1c6f4cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'serial': 'eae0d4c1-f3c3-4ac8-8919-affeab99faec'}, 'attachment_id': '8458711a-6ada-4edf-a506-3e345cc5608b', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.network.neutron [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:04:53 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:53 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.objects.instance [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.objects.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Object Instance<1e894c11-33a8-4e34-be15-277fb1c6f4cd> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:53 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:53 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:53 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee8dce2-53e3-49cd-a660-3d31ab63bc88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:04:53 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca826d-915b-40b5-85ea-9518b5206f8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec] added
Nov 08 14:04:53 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a79321-ede9-4f30-bea1-c482bfd77575]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2584b31d-8ce9-4fa0-b722-4c637b79d7f2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvwzQTmE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvwzQTmE" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a77129-9d01-4737-8e63-93b4cb9093a8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvwzQTmE'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab7cea-3899-44c6-8bd1-3fc0434984d2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee591254-627d-4a66-b4f1-d66340dcacce]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[011fd0e3-b1bf-4b80-bf06-61b618a9db40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]
Nov 08 14:04:54 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f635c861-2e47-4cad-bbb6-7db1f1556773]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bfbd14-7146-4ad9-aa84-d590bd1e1ae1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:54 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505c192-7c9b-43d1-aff4-0f84efc9b8b1]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updated VIF entry in instance network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG nova.network.neutron [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a72112f9-c937-40ab-b88e-633adab5eb76 req-109b3fe9-d20c-4af3-8036-765f8b05babf service nova] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:54 user nova-compute[87365]: INFO nova.compute.manager [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Terminating instance
Nov 08 14:04:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:04:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-8a5ce48f-4070-4fc8-8bea-625f530b4080 req-d0280566-efb3-47c3-a4f5-cc0bcb9afc3c service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23537336637666333', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537336637666333', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-716194144',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:04:20Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.objects.instance [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.objects.base [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Object Instance<1e894c11-33a8-4e34-be15-277fb1c6f4cd> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:04:55 user nova-compute[87365]:   <uuid>1e894c11-33a8-4e34-be15-277fb1c6f4cd</uuid>
Nov 08 14:04:55 user nova-compute[87365]:   <name>instance-00000022</name>
Nov 08 14:04:55 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:04:55 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:04:55 user nova-compute[87365]:   <metadata>
Nov 08 14:04:55 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:04:55 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:04:55 user nova-compute[87365]:       <nova:name>tempest-TestShelveInstance-server-1018597737</nova:name>
Nov 08 14:04:55 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:04:53</nova:creationTime>
Nov 08 14:04:55 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:04:55 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:04:55 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:04:55 user nova-compute[87365]:       <nova:owner>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:user uuid="b64c48aad8f24a63a24044d7e803b2ee">tempest-TestShelveInstance-1913358462-project-member</nova:user>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:project uuid="0c3523c776dd47cdbae107f85e075ed3">tempest-TestShelveInstance-1913358462</nova:project>
Nov 08 14:04:55 user nova-compute[87365]:       </nova:owner>
Nov 08 14:04:55 user nova-compute[87365]:       <nova:ports>
Nov 08 14:04:55 user nova-compute[87365]:         <nova:port uuid="b73e3d43-0bda-475a-a795-d4891abed15e">
Nov 08 14:04:55 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 14:04:55 user nova-compute[87365]:         </nova:port>
Nov 08 14:04:55 user nova-compute[87365]:       </nova:ports>
Nov 08 14:04:55 user nova-compute[87365]:     </nova:instance>
Nov 08 14:04:55 user nova-compute[87365]:   </metadata>
Nov 08 14:04:55 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:04:55 user nova-compute[87365]:     <system>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="serial">1e894c11-33a8-4e34-be15-277fb1c6f4cd</entry>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="uuid">1e894c11-33a8-4e34-be15-277fb1c6f4cd</entry>
Nov 08 14:04:55 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:04:55 user nova-compute[87365]:     </system>
Nov 08 14:04:55 user nova-compute[87365]:   </sysinfo>
Nov 08 14:04:55 user nova-compute[87365]:   <os>
Nov 08 14:04:55 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:04:55 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:04:55 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:04:55 user nova-compute[87365]:   </os>
Nov 08 14:04:55 user nova-compute[87365]:   <features>
Nov 08 14:04:55 user nova-compute[87365]:     <acpi/>
Nov 08 14:04:55 user nova-compute[87365]:     <apic/>
Nov 08 14:04:55 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:04:55 user nova-compute[87365]:   </features>
Nov 08 14:04:55 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:04:55 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:04:55 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:04:55 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:04:55 user nova-compute[87365]:   </clock>
Nov 08 14:04:55 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:04:55 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:04:55 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:04:55 user nova-compute[87365]:   </cpu>
Nov 08 14:04:55 user nova-compute[87365]:   <devices>
Nov 08 14:04:55 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:04:55 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:04:55 user nova-compute[87365]:       <source dev="/dev/sdf"/>
Nov 08 14:04:55 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:04:55 user nova-compute[87365]:       <serial>eae0d4c1-f3c3-4ac8-8919-affeab99faec</serial>
Nov 08 14:04:55 user nova-compute[87365]:     </disk>
Nov 08 14:04:55 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:04:55 user nova-compute[87365]:       <mac address="fa:16:3e:14:5b:13"/>
Nov 08 14:04:55 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:04:55 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:04:55 user nova-compute[87365]:       <target dev="tapb73e3d43-0b"/>
Nov 08 14:04:55 user nova-compute[87365]:     </interface>
Nov 08 14:04:55 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:04:55 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd/console.log" append="off"/>
Nov 08 14:04:55 user nova-compute[87365]:     </serial>
Nov 08 14:04:55 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:04:55 user nova-compute[87365]:     <video>
Nov 08 14:04:55 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:04:55 user nova-compute[87365]:     </video>
Nov 08 14:04:55 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:04:55 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:04:55 user nova-compute[87365]:     </rng>
Nov 08 14:04:55 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:04:55 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:04:55 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:04:55 user nova-compute[87365]:     </memballoon>
Nov 08 14:04:55 user nova-compute[87365]:   </devices>
Nov 08 14:04:55 user nova-compute[87365]: </domain>
Nov 08 14:04:55 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-716194144',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:01:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:04:20Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG os_vif [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9535095-a8da-51c9-97db-5661d286ec03', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73e3d43-0b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73e3d43-0b, col_values=(('qos', UUID('ea4b023b-9436-4818-a766-cb33e7fa8712')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73e3d43-0b, col_values=(('external_ids', {'iface-id': 'b73e3d43-0bda-475a-a795-d4891abed15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:5b:13', 'vm-uuid': '1e894c11-33a8-4e34-be15-277fb1c6f4cd'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: INFO os_vif [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b')
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] No VIF found with MAC fa:16:3e:14:5b:13, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Instance destroyed successfully.
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lazy-loading 'resources' on Instance uuid b3bc6678-0f78-4778-9a0d-95e0a7c3e690 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1250423349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1250423349',id=2,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f67a8efbc924527972b7f3a4fdac0cf',ramdisk_id='',reservation_id='r-3ha8oeqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:45:29Z,user_data=None,user_id='99bfb420b98c45d9b13589c4b2153fed',uuid=b3bc6678-0f78-4778-9a0d-95e0a7c3e690,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converting VIF {"id": "886761b5-d79a-4e9e-8882-6c456a289b97", "address": "fa:16:3e:8e:4e:43", "network": {"id": "03c37963-2650-44ab-8395-056dc5ceba6d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-918523803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f67a8efbc924527972b7f3a4fdac0cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886761b5-d7", "ovs_interfaceid": "886761b5-d79a-4e9e-8882-6c456a289b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_vif [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap886761b5-d7, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f58cffc5-a45a-47dd-a2d9-807ea8648fcb) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: INFO os_vif [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4e:43,bridge_name='br-int',has_traffic_filtering=True,id=886761b5-d79a-4e9e-8882-6c456a289b97,network=Network(03c37963-2650-44ab-8395-056dc5ceba6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886761b5-d7')
Nov 08 14:04:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Deleting instance files /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690_del
Nov 08 14:04:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Deletion of /opt/stack/data/nova/instances/b3bc6678-0f78-4778-9a0d-95e0a7c3e690_del complete
Nov 08 14:04:56 user nova-compute[87365]: INFO nova.compute.manager [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:04:56 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 is timed out.
Nov 08 14:04:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully detached device vdb from instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 from the live domain config.
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbcqzYhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:56 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7153cd80-2613-46e6-864b-c5cd029f54e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:04:56 user nova-compute[87365]: No targets found.
Nov 08 14:04:56 user nova-compute[87365]: iSNS:
Nov 08 14:04:56 user nova-compute[87365]: No targets found.
Nov 08 14:04:56 user nova-compute[87365]: STATIC:
Nov 08 14:04:56 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:04:56 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:56 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:56 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19
Nov 08 14:04:56 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:56 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:56 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0
Nov 08 14:04:56 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:56 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:56 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f
Nov 08 14:04:56 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:56 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:56 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:04:56 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:56 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:56 user nova-compute[87365]: FIRMWARE:
Nov 08 14:04:56 user nova-compute[87365]: No targets found.
Nov 08 14:04:56 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:04:56 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:04:56 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c10468-e4da-41a7-8122-d7e7284dbff7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5246d66a-84a1-4b66-8f3b-caabbdcecb3c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:56 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:56 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:56 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf81b45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8c4216-91ce-4a8e-b903-2f521ba86702]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.061s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d0ead-45ad-4444-8083-4a054e1afe02]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67c54e6-2c3a-4803-9292-e503328c9db0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8143ac8d-dbf8-492f-8d64-a14af3598f5d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c572745-6dc6-4a8c-b9fb-3473a3ccfbe7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e222d-5718-4f14-8df2-c1488d1c7246]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260]
Nov 08 14:04:56 user nova-compute[87365]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:56 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da6f7c3-2cd3-4e73-845b-4417278110e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c77073-8864-46b4-9003-4961563c2c47]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.546s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== disconnect_volume: return (547ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:57 user nova-compute[87365]: WARNING nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state deleting.
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:57 user nova-compute[87365]: WARNING nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state deleting.
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:57 user nova-compute[87365]: WARNING nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state deleting.
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-unplugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Acquiring lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] No waiting events found dispatching network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:57 user nova-compute[87365]: WARNING nova.compute.manager [req-96b34bdc-18da-4794-8a01-5c85ec1f70fb req-1d4d9c40-2d5b-4b41-abc4-5838bb9eb7e3 service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received unexpected event network-vif-plugged-886761b5-d79a-4e9e-8882-6c456a289b97 for instance with vm_state active and task_state deleting.
Nov 08 14:04:57 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:04:57 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Took 1.23 seconds to deallocate network for instance.
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:58 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Deleted allocations for instance b3bc6678-0f78-4778-9a0d-95e0a7c3e690
Nov 08 14:04:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1aa16b18-15d3-4a02-9fff-439a81e06bcb tempest-ServerBootFromVolumeStableRescueTest-1624221445 tempest-ServerBootFromVolumeStableRescueTest-1624221445-project-member] Lock "b3bc6678-0f78-4778-9a0d-95e0a7c3e690" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.604s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.objects.instance [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-fd502464-77a4-4be4-95c4-95496f140e80 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.789s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:04:58 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd66e505-8e3f-4462-953f-3911d748eb69 is timed out.
Nov 08 14:04:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully detached device vdb from instance cd66e505-8e3f-4462-953f-3911d748eb69 from the live domain config.
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKgmabdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:04:58 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c81737-fa4f-4f20-9ed1-9ee9259273be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:04:58 user nova-compute[87365]: No targets found.
Nov 08 14:04:58 user nova-compute[87365]: iSNS:
Nov 08 14:04:58 user nova-compute[87365]: No targets found.
Nov 08 14:04:58 user nova-compute[87365]: STATIC:
Nov 08 14:04:58 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:04:58 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:58 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:58 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19
Nov 08 14:04:58 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:58 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:58 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f
Nov 08 14:04:58 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:58 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:58 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:04:58 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:04:58 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:04:58 user nova-compute[87365]: FIRMWARE:
Nov 08 14:04:58 user nova-compute[87365]: No targets found.
Nov 08 14:04:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:04:58 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:04:58 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99bbfd4-4c59-49fa-9d10-a86a0d061348]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:04:58 user nova-compute[87365]: INFO nova.compute.claims [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Claim successful on node user
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de3dcf1-85fd-490a-9489-7a62e558c2b6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:04:58 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:04:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d1c3d0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a76242-e598-4528-a9a4-272acf2d3218]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ebd67-1a4f-46fe-90e9-c42edc6a602f]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d44fe8c-e250-4451-ab26-f0e13a023b9a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:04:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d16779-4549-41ff-830d-a36db9da02d3]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac3fa8-9b21-4a3d-82fa-6143f5609882]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[023fb518-801c-4f5a-ada0-8446bdaf31ed]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260]
Nov 08 14:04:59 user nova-compute[87365]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19, portal: 172.16.0.220,3260] successful.
Nov 08 14:04:59 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3665f3c7-ac1c-4a5b-a02f-2d1fc7d3fc19 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da0176-f7e3-4859-a04e-945626bd7694]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] <== disconnect_volume: return (385ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:04:59 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:04:59 user nova-compute[87365]: INFO nova.virt.block_device [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Booting with volume snapshot 5c286856-caa8-4776-9f57-97c91fd659ff at /dev/vda
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.policy [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: b3bc6678-0f78-4778-9a0d-95e0a7c3e690] Received event network-vif-deleted-886761b5-d79a-4e9e-8882-6c456a289b97 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:59 user nova-compute[87365]: WARNING nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:04:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:04:59 user nova-compute[87365]: WARNING nova.compute.manager [req-b45de5ab-118d-42ec-b029-399dd5047ae5 req-0bbe82e6-702b-4678-b122-b28906e8035c service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 14:05:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'flavor' on Instance uuid cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:05:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2515dc7a-74ec-4ec5-aab3-2e9d771fb42d tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.959s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:05:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:05:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance spawned successfully.
Nov 08 14:05:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:05:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-03aedd06-fab1-4f03-b941-85dcbb0fe054 tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 40.158s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Successfully created port: a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Successfully updated port: a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-changed-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Refreshing instance network info cache due to event network-changed-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] Acquiring lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:05:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:05:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updating instance_info_cache with network_info: [{"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:05:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:05:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Instance network_info: |[{"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:05:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] Acquired lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:05:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Refreshing network info cache for port a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:05:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updated VIF entry in instance network info cache for port a3bb4bb1-42e6-4237-beae-5f0d902ee6d7. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:05:03 user nova-compute[87365]: DEBUG nova.network.neutron [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updating instance_info_cache with network_info: [{"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:05:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a608560-87b3-4d94-8975-59c8a5dea00d req-4fcb1e3e-305c-425a-a501-2874e5dd39f2 service nova] Releasing lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:05:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3a335-cf07-477c-9e04-09548989dfea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a04471-5ab1-4620-b3a3-24312d85524d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3985d-af5f-443f-b455-ebfe7b4a5947]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874c698-9647-4dac-a2fb-62c87873bc15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:05:10 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:05:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb17f1-c709-4b2c-9ccb-4c856581f3fb]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:05:10 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updating existing volume attachment record: 47c44ffb-014c-4cce-8727-3a20f66e8cca {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:05:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing instance network info cache due to event network-changed-d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] Acquiring lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] Acquired lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Refreshing network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:28 user nova-compute[87365]: INFO nova.compute.manager [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Terminating instance
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-unplugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] No waiting events found dispatching network-vif-unplugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-677fcf50-ef9c-4a3b-bd49-1165ea2a056e req-cb978f35-8c8b-491f-af2b-42b9217d1890 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-unplugged-d9534cb0-3733-4da4-94f9-6f95688c756c for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:05:28 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Instance destroyed successfully.
Nov 08 14:05:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'resources' on Instance uuid cd66e505-8e3f-4462-953f-3911d748eb69 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updated VIF entry in instance network info cache for port d9534cb0-3733-4da4-94f9-6f95688c756c. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating instance_info_cache with network_info: [{"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1111874855',display_name='tempest-TestStampPattern-server-1111874855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1111874855',id=36,image_ref='fbb1505a-0628-4cfd-83ff-976daeb2a56e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-mddkuvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='41b54c9e-bc8b-4f7b-8203-628370bb251a',image_min_disk='1',image_min_ram='0',image_owner_id='a5b55494d4d04b9584f2cd125ebe9b67',image_owner_project_name='tempest-TestStampPattern-135387725',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-135387725-project-member',image_user_id='c3e29e071ca349acb9c8f88ff94673f8',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:02:12Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=cd66e505-8e3f-4462-953f-3911d748eb69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "d9534cb0-3733-4da4-94f9-6f95688c756c", "address": "fa:16:3e:f1:b6:8d", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9534cb0-37", "ovs_interfaceid": "d9534cb0-3733-4da4-94f9-6f95688c756c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG os_vif [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9534cb0-37, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-dbb42430-aa52-40dc-8c52-20bfe4c9088b req-d6b4c049-d74a-4c2d-97fa-e38adda4e84c service nova] Releasing lock "refresh_cache-cd66e505-8e3f-4462-953f-3911d748eb69" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f448c20-1feb-4940-90ad-c3bf9ab841bd) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:05:29 user nova-compute[87365]: INFO os_vif [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b6:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9534cb0-3733-4da4-94f9-6f95688c756c,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9534cb0-37')
Nov 08 14:05:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Deleting instance files /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69_del
Nov 08 14:05:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Deletion of /opt/stack/data/nova/instances/cd66e505-8e3f-4462-953f-3911d748eb69_del complete
Nov 08 14:05:29 user nova-compute[87365]: INFO nova.compute.manager [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 14:05:29 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:05:29 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Took 0.49 seconds to deallocate network for instance.
Nov 08 14:05:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:30 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Deleted allocations for instance cd66e505-8e3f-4462-953f-3911d748eb69
Nov 08 14:05:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-90a97633-3521-4c63-90c9-d4da0317615f tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "cd66e505-8e3f-4462-953f-3911d748eb69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.137s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] Acquiring lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] Lock "cd66e505-8e3f-4462-953f-3911d748eb69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] No waiting events found dispatching network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:05:30 user nova-compute[87365]: WARNING nova.compute.manager [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received unexpected event network-vif-plugged-d9534cb0-3733-4da4-94f9-6f95688c756c for instance with vm_state deleted and task_state None.
Nov 08 14:05:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-7820c957-67b5-4d48-993e-46861d6fcd15 req-2a6d3c3f-ab54-45ba-a01a-d7f2e0e201b9 service nova] [instance: cd66e505-8e3f-4462-953f-3911d748eb69] Received event network-vif-deleted-d9534cb0-3733-4da4-94f9-6f95688c756c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:05:40 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Creating image(s)
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Ensure instance console log exists: /opt/stack/data/nova/instances/47fe208c-f65d-4054-b464-2962ab2ed947/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Start _get_guest_xml network_info=[{"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T14:04:40Z,direct_url=<?>,disk_format='qcow2',id=70a505f9-1d91-4a52-beec-62e5e4b7c2c3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-218066868',owner='72686a705c7447abb29d45ccec5a3c1f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T14:04:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMnEKeRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47fe208c-f65d-4054-b464-2962ab2ed947', 'attached_at': '', 'detached_at': '', 'volume_id': 'e66bee54-cb73-4d39-8db3-13245aa79a84', 'serial': 'e66bee54-cb73-4d39-8db3-13245aa79a84'}, 'attachment_id': '47c44ffb-014c-4cce-8727-3a20f66e8cca', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:05:40 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:05:40 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T14:04:40Z,direct_url=<?>,disk_format='qcow2',id=70a505f9-1d91-4a52-beec-62e5e4b7c2c3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-218066868',owner='72686a705c7447abb29d45ccec5a3c1f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T14:04:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMnEKeRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:05:40 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:05:40 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:05:40 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bba26e-b434-457b-8d9f-e01339a521d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:05:40 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[85734810-b88b-4d24-9fed-b17a43d00f23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84] added
Nov 08 14:05:40 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bce69e-2a64-478d-be7c-e432f4fbf671]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc1368-b2d9-4468-b50b-2ebc03defb13]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:40 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMnEKeRv {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMnEKeRv" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[916d8683-60dd-46e3-b18b-915bea0ae7fa]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMnEKeRv'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510fe76-28be-4a9c-b259-1cf1148d2745]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc81ba-64cd-4144-8753-2b8ae3bcbf52]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:05:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:05:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2752c0-4f9a-4fbe-ba05-9d80f7c56521]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260]
Nov 08 14:05:41 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260] successful.
Nov 08 14:05:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[452ace56-d260-4b7b-a70a-969ea04605dd]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d155be65-3075-415c-b165-6b2282092d68]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:05:41 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:05:41 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e74e5a-42df-4869-a950-d9b5841b7de5]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG nova.objects.instance [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'flavor' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:41 user nova-compute[87365]: INFO nova.compute.manager [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Attaching volume 7cebe037-4330-4550-895b-fe1b91f8dadd to /dev/vdb
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.utils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307c78b-83f7-47fc-b488-49bf52f9c2a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a6c80-6fbd-47e3-9cc0-2c1b59312adf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eae854-edf5-4fd6-8511-7390dad139c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f97ec3-4031-4dce-ab43-d50e6c94497d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:05:42 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cecbc21-cbee-4781-8c77-e43e507efcdb]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.utils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating existing volume attachment record: f58967c5-48d3-4684-8d80-5253548ff1c1 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMnEKeRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26439633365616462', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439633365616462', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1896693949',id=39,image_ref='70a505f9-1d91-4a52-beec-62e5e4b7c2c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXH7eMQnto+C6h1D3n9R4xklm6QSqjY2M7ztELvYsPBi72OGXpWcN7TqP2tTEmLSMSz1vS27gDsHDms1aMLzQChRQC4xkzwk7/WlGuKLg1xm5Nn9BW4jBhwqxaWB9oU+w==',key_name='tempest-keypair-1681930772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-fj2syins',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-596681261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=47fe208c-f65d-4054-b464-2962ab2ed947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid 47fe208c-f65d-4054-b464-2962ab2ed947 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:05:42 user nova-compute[87365]:   <uuid>47fe208c-f65d-4054-b464-2962ab2ed947</uuid>
Nov 08 14:05:42 user nova-compute[87365]:   <name>instance-00000027</name>
Nov 08 14:05:42 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:05:42 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:05:42 user nova-compute[87365]:   <metadata>
Nov 08 14:05:42 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:05:42 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1896693949</nova:name>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:05:40</nova:creationTime>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:05:42 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:05:42 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:owner>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 14:05:42 user nova-compute[87365]:       </nova:owner>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:root type="image" uuid="70a505f9-1d91-4a52-beec-62e5e4b7c2c3"/>
Nov 08 14:05:42 user nova-compute[87365]:       <nova:ports>
Nov 08 14:05:42 user nova-compute[87365]:         <nova:port uuid="a3bb4bb1-42e6-4237-beae-5f0d902ee6d7">
Nov 08 14:05:42 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 14:05:42 user nova-compute[87365]:         </nova:port>
Nov 08 14:05:42 user nova-compute[87365]:       </nova:ports>
Nov 08 14:05:42 user nova-compute[87365]:     </nova:instance>
Nov 08 14:05:42 user nova-compute[87365]:   </metadata>
Nov 08 14:05:42 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:05:42 user nova-compute[87365]:     <system>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="serial">47fe208c-f65d-4054-b464-2962ab2ed947</entry>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="uuid">47fe208c-f65d-4054-b464-2962ab2ed947</entry>
Nov 08 14:05:42 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:05:42 user nova-compute[87365]:     </system>
Nov 08 14:05:42 user nova-compute[87365]:   </sysinfo>
Nov 08 14:05:42 user nova-compute[87365]:   <os>
Nov 08 14:05:42 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:05:42 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:05:42 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:05:42 user nova-compute[87365]:   </os>
Nov 08 14:05:42 user nova-compute[87365]:   <features>
Nov 08 14:05:42 user nova-compute[87365]:     <acpi/>
Nov 08 14:05:42 user nova-compute[87365]:     <apic/>
Nov 08 14:05:42 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:05:42 user nova-compute[87365]:   </features>
Nov 08 14:05:42 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:05:42 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:05:42 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:05:42 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:05:42 user nova-compute[87365]:   </clock>
Nov 08 14:05:42 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:05:42 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:05:42 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:05:42 user nova-compute[87365]:   </cpu>
Nov 08 14:05:42 user nova-compute[87365]:   <devices>
Nov 08 14:05:42 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:05:42 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:05:42 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 14:05:42 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:05:42 user nova-compute[87365]:       <serial>e66bee54-cb73-4d39-8db3-13245aa79a84</serial>
Nov 08 14:05:42 user nova-compute[87365]:     </disk>
Nov 08 14:05:42 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:05:42 user nova-compute[87365]:       <mac address="fa:16:3e:0b:5c:ab"/>
Nov 08 14:05:42 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:05:42 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:05:42 user nova-compute[87365]:       <target dev="tapa3bb4bb1-42"/>
Nov 08 14:05:42 user nova-compute[87365]:     </interface>
Nov 08 14:05:42 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:05:42 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/47fe208c-f65d-4054-b464-2962ab2ed947/console.log" append="off"/>
Nov 08 14:05:42 user nova-compute[87365]:     </serial>
Nov 08 14:05:42 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:05:42 user nova-compute[87365]:     <video>
Nov 08 14:05:42 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:05:42 user nova-compute[87365]:     </video>
Nov 08 14:05:42 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:05:42 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:05:42 user nova-compute[87365]:     </rng>
Nov 08 14:05:42 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:05:42 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:05:42 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:05:42 user nova-compute[87365]:     </memballoon>
Nov 08 14:05:42 user nova-compute[87365]:   </devices>
Nov 08 14:05:42 user nova-compute[87365]: </domain>
Nov 08 14:05:42 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1896693949',id=39,image_ref='70a505f9-1d91-4a52-beec-62e5e4b7c2c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXH7eMQnto+C6h1D3n9R4xklm6QSqjY2M7ztELvYsPBi72OGXpWcN7TqP2tTEmLSMSz1vS27gDsHDms1aMLzQChRQC4xkzwk7/WlGuKLg1xm5Nn9BW4jBhwqxaWB9oU+w==',key_name='tempest-keypair-1681930772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-fj2syins',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-596681261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=47fe208c-f65d-4054-b464-2962ab2ed947,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG os_vif [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b626ae6e-17f6-530f-8cdc-c3d5b3bfefeb', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3bb4bb1-42, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3bb4bb1-42, col_values=(('qos', UUID('7a407396-9737-43f9-a3a2-58ad9f03b72c')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3bb4bb1-42, col_values=(('external_ids', {'iface-id': 'a3bb4bb1-42e6-4237-beae-5f0d902ee6d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:5c:ab', 'vm-uuid': '47fe208c-f65d-4054-b464-2962ab2ed947'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:42 user nova-compute[87365]: INFO os_vif [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42')
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:0b:5c:ab, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:42 user nova-compute[87365]: INFO nova.compute.manager [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Detaching volume 1f0d508d-c0ce-4ca4-800d-b5a209204a9f
Nov 08 14:05:42 user nova-compute[87365]: INFO nova.virt.block_device [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Attempting to driver detach volume 1f0d508d-c0ce-4ca4-800d-b5a209204a9f from mountpoint /dev/vdb
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Attempting to detach device vdb from instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:05:42 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:05:42 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:05:42 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:05:42 user nova-compute[87365]:   <serial>1f0d508d-c0ce-4ca4-800d-b5a209204a9f</serial>
Nov 08 14:05:42 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:05:42 user nova-compute[87365]: </disk>
Nov 08 14:05:42 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:05:42 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully detached device vdb from instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 from the persistent domain config.
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:05:42 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:05:42 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:05:42 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:05:42 user nova-compute[87365]:   <serial>1f0d508d-c0ce-4ca4-800d-b5a209204a9f</serial>
Nov 08 14:05:42 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:05:42 user nova-compute[87365]: </disk>
Nov 08 14:05:42 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:05:42 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] No waiting events found dispatching network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:05:44 user nova-compute[87365]: WARNING nova.compute.manager [req-e1208ab4-d37f-4f2b-996a-f14280a12e95 req-c61d8e41-07e6-47db-bcb6-e62be7acb85c service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received unexpected event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 for instance with vm_state building and task_state spawning.
Nov 08 14:05:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] No waiting events found dispatching network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:05:46 user nova-compute[87365]: WARNING nova.compute.manager [req-7a10ddfc-e2b1-49d2-96e2-691ed71d6765 req-5e177cb9-487b-41c0-830b-847253253139 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received unexpected event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 for instance with vm_state building and task_state spawning.
Nov 08 14:05:46 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Instance spawned successfully.
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:05:46 user nova-compute[87365]: INFO nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 08 14:05:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:05:46 user nova-compute[87365]: INFO nova.compute.manager [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Took 47.62 seconds to build instance.
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d01f6fb3-7dc8-4dd0-b713-3bd09a65379a tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.816s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:05:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7712MB free_disk=24.279483795166016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 47fe208c-f65d-4054-b464-2962ab2ed947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:05:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:05:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [{"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-7f48b991-bd55-400d-ac6a-5ed4f976b6a0" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:05:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:05:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:05:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:06:01 user nova-compute[87365]: INFO nova.compute.claims [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Claim successful on node user
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:06:01 user nova-compute[87365]: DEBUG nova.policy [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8951eb125524b84a913e2e66e857fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c632e7ef13f4b03b843ce2996ecd29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:06:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Creating image(s)
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.215s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk 1073741824" returned: 0 in 0.062s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Cannot resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Ensure instance console log exists: /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Successfully created port: 37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:06:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 is timed out.
Nov 08 14:06:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully detached device vdb from instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 from the live domain config.
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWqgciuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:06:03 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1c3c2a-9afd-4c03-9081-3b5bf15ae34f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:06:03 user nova-compute[87365]: No targets found.
Nov 08 14:06:03 user nova-compute[87365]: iSNS:
Nov 08 14:06:03 user nova-compute[87365]: No targets found.
Nov 08 14:06:03 user nova-compute[87365]: STATIC:
Nov 08 14:06:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:06:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84
Nov 08 14:06:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f
Nov 08 14:06:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:06:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:03 user nova-compute[87365]: FIRMWARE:
Nov 08 14:06:03 user nova-compute[87365]: No targets found.
Nov 08 14:06:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:06:03 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:06:03 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e726602-c360-4af1-b1ad-aca69c1661f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Successfully updated port: 37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf06130-128b-4d79-8f47-9eae55563adb]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:03 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf8678280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-changed-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.compute.manager [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Refreshing instance network info cache due to event network-changed-37bcfa01-a258-4259-8c18-44119de8d394. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511bf98-1292-4297-876c-accc504ced42]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7de2bb-8470-4dfa-b732-d9b51cafd74e]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4485b2-c012-4aad-a334-91e9f40595b1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d607cc-b86a-470a-9d36-99317744e44d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed37aedc-26c0-4653-88b5-81e9935f1d1c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ebf6c-21cc-44fb-8bd9-dc96481cd52a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260]
Nov 08 14:06:03 user nova-compute[87365]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f, portal: 172.16.0.220,3260] successful.
Nov 08 14:06:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5808326c-5197-4285-983a-f3b08c5f835e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== disconnect_volume: return (354ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:06:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.neutron [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance network_info: |[{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.neutron [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Refreshing network info cache for port 37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start _get_guest_xml network_info=[{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:06:04 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:06:04 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'pci_devices' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:06:04 user nova-compute[87365]:   <uuid>937e7773-8812-406a-87f3-48373678eeb1</uuid>
Nov 08 14:06:04 user nova-compute[87365]:   <name>instance-00000028</name>
Nov 08 14:06:04 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:06:04 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:06:04 user nova-compute[87365]:   <metadata>
Nov 08 14:06:04 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:06:04 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeTestJSON-server-1435204684</nova:name>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:06:04</nova:creationTime>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:06:04 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:06:04 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:owner>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:user uuid="c8951eb125524b84a913e2e66e857fbc">tempest-AttachVolumeTestJSON-1235364264-project-member</nova:user>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:project uuid="2c632e7ef13f4b03b843ce2996ecd29f">tempest-AttachVolumeTestJSON-1235364264</nova:project>
Nov 08 14:06:04 user nova-compute[87365]:       </nova:owner>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:06:04 user nova-compute[87365]:       <nova:ports>
Nov 08 14:06:04 user nova-compute[87365]:         <nova:port uuid="37bcfa01-a258-4259-8c18-44119de8d394">
Nov 08 14:06:04 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:06:04 user nova-compute[87365]:         </nova:port>
Nov 08 14:06:04 user nova-compute[87365]:       </nova:ports>
Nov 08 14:06:04 user nova-compute[87365]:     </nova:instance>
Nov 08 14:06:04 user nova-compute[87365]:   </metadata>
Nov 08 14:06:04 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:06:04 user nova-compute[87365]:     <system>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="serial">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="uuid">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:06:04 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:06:04 user nova-compute[87365]:     </system>
Nov 08 14:06:04 user nova-compute[87365]:   </sysinfo>
Nov 08 14:06:04 user nova-compute[87365]:   <os>
Nov 08 14:06:04 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:06:04 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:06:04 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:06:04 user nova-compute[87365]:   </os>
Nov 08 14:06:04 user nova-compute[87365]:   <features>
Nov 08 14:06:04 user nova-compute[87365]:     <acpi/>
Nov 08 14:06:04 user nova-compute[87365]:     <apic/>
Nov 08 14:06:04 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:06:04 user nova-compute[87365]:   </features>
Nov 08 14:06:04 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:06:04 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:06:04 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:06:04 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:06:04 user nova-compute[87365]:   </clock>
Nov 08 14:06:04 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:06:04 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:06:04 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:06:04 user nova-compute[87365]:   </cpu>
Nov 08 14:06:04 user nova-compute[87365]:   <devices>
Nov 08 14:06:04 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:06:04 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:06:04 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk"/>
Nov 08 14:06:04 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:06:04 user nova-compute[87365]:     </disk>
Nov 08 14:06:04 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:06:04 user nova-compute[87365]:       <mac address="fa:16:3e:65:e2:8a"/>
Nov 08 14:06:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:06:04 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:06:04 user nova-compute[87365]:       <target dev="tap37bcfa01-a2"/>
Nov 08 14:06:04 user nova-compute[87365]:     </interface>
Nov 08 14:06:04 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:06:04 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/console.log" append="off"/>
Nov 08 14:06:04 user nova-compute[87365]:     </serial>
Nov 08 14:06:04 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:06:04 user nova-compute[87365]:     <video>
Nov 08 14:06:04 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:06:04 user nova-compute[87365]:     </video>
Nov 08 14:06:04 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:06:04 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:06:04 user nova-compute[87365]:     </rng>
Nov 08 14:06:04 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:06:04 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:06:04 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:06:04 user nova-compute[87365]:     </memballoon>
Nov 08 14:06:04 user nova-compute[87365]:   </devices>
Nov 08 14:06:04 user nova-compute[87365]: </domain>
Nov 08 14:06:04 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG os_vif [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a3d642f-e5cb-56bc-8929-a20462c4051d', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37bcfa01-a2, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37bcfa01-a2, col_values=(('qos', UUID('ec4693be-b298-4db5-a373-7d689044a778')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37bcfa01-a2, col_values=(('external_ids', {'iface-id': '37bcfa01-a258-4259-8c18-44119de8d394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:e2:8a', 'vm-uuid': '937e7773-8812-406a-87f3-48373678eeb1'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:04 user nova-compute[87365]: INFO os_vif [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No VIF found with MAC fa:16:3e:65:e2:8a, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.neutron [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updated VIF entry in instance network info cache for port 37bcfa01-a258-4259-8c18-44119de8d394. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG nova.network.neutron [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3faaf111-515e-45a4-89bd-7a3cbe11725f req-c2b1f661-1ee5-480a-81e3-9805a10b2d93 service nova] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'flavor' on Instance uuid 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d29ec213-681a-41ff-a5bb-ec8cbd7c7caf tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.359s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.201s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:05 user nova-compute[87365]: INFO nova.compute.manager [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Terminating instance
Nov 08 14:06:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.volume.cinder [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Update attachment failed for attachment f58967c5-48d3-4684-8d80-5253548ff1c1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Failed to attach 7cebe037-4330-4550-895b-fe1b91f8dadd at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Traceback (most recent call last):
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     self._do_attach(context, instance, volume, volume_api,
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     self._volume_attach(context, volume, connector, instance,
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     connection_info = volume_api.attachment_update(
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     res = method(self, ctx, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     return method.func(obj, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     resp = self._update('/attachments/%s' % id, body)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     return self.request(url, method, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723]     raise exceptions.from_response(resp, body)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469)
Nov 08 14:06:05 user nova-compute[87365]: ERROR nova.compute.manager [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] 
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-unplugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] No waiting events found dispatching network-vif-unplugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-11f53da4-7cf2-46f2-a1ab-3a8581f921c1 req-8beaf73c-7e0e-43f5-bccc-13ea8f4aaf0a service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-unplugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.829s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server [None req-1e7c2232-e923-4eab-a15b-cfa5d3266308 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6d80fa6-e6dd-4d4a-bc42-2f58c919d469)
Nov 08 14:06:05 user nova-compute[87365]: ERROR oslo_messaging.rpc.server 
Nov 08 14:06:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Instance destroyed successfully.
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lazy-loading 'resources' on Instance uuid 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-499586924',display_name='tempest-VolumesSnapshotTestJSON-instance-499586924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-499586924',id=37,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5dsPJrayJA20zbr8Cq/L09cWiamNRn4dEiy/ZoG6l8CRz3aScIH/3qlrMc+/NgsJ1FZ6zp4f5lFMa/OV0cEC6GmLcZjRymVTHZS+EUXSNvzlwvk626bo9HoK3nCNUpiw==',key_name='tempest-keypair-1836760181',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a39c014336e54dcfa0d31ac286cc62d4',ramdisk_id='',reservation_id='r-3itrc0qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1602758470',owner_user_name='tempest-VolumesSnapshotTestJSON-1602758470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e83098542a5b412ca87f6ee5a6c2b499',uuid=9cbcde5a-dfe9-42b3-853a-f3b25e9acd30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converting VIF {"id": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "address": "fa:16:3e:4a:3a:e5", "network": {"id": "b0fb0c59-ea79-457b-9f9a-99fe9c394e53", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-343725441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a39c014336e54dcfa0d31ac286cc62d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea00190-d2", "ovs_interfaceid": "4ea00190-d2ee-4a0f-9e96-e86739cb4a95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_vif [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea00190-d2, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=271fd8ac-d5a6-43f6-957f-218658cd472a) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: INFO os_vif [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:3a:e5,bridge_name='br-int',has_traffic_filtering=True,id=4ea00190-d2ee-4a0f-9e96-e86739cb4a95,network=Network(b0fb0c59-ea79-457b-9f9a-99fe9c394e53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea00190-d2')
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWqgciuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:06:06 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4f4360-be66-4122-bbc7-81ddb016d1df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:06:06 user nova-compute[87365]: No targets found.
Nov 08 14:06:06 user nova-compute[87365]: iSNS:
Nov 08 14:06:06 user nova-compute[87365]: No targets found.
Nov 08 14:06:06 user nova-compute[87365]: STATIC:
Nov 08 14:06:06 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:06:06 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:06 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:06 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84
Nov 08 14:06:06 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:06 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:06 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:06:06 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:06 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:06 user nova-compute[87365]: FIRMWARE:
Nov 08 14:06:06 user nova-compute[87365]: No targets found.
Nov 08 14:06:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:06:06 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:06:06 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f0d508d-c0ce-4ca4-800d-b5a209204a9f', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42e678-2d63-4b4e-b99c-e3b6143fdce5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[caee6fd7-9c8b-43f5-ac08-c3f928b344d5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:06 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:06 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:06 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:06 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:06 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4c1b250>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] <== disconnect_volume: return (76ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:06:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Deleting instance files /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30_del
Nov 08 14:06:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Deletion of /opt/stack/data/nova/instances/9cbcde5a-dfe9-42b3-853a-f3b25e9acd30_del complete
Nov 08 14:06:06 user nova-compute[87365]: INFO nova.compute.manager [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 08 14:06:06 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:06:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:07 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Took 0.72 seconds to deallocate network for instance.
Nov 08 14:06:07 user nova-compute[87365]: WARNING nova.volume.cinder [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Attachment 640a1550-ccf1-49e7-b555-3a16a3b2aa35 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 640a1550-ccf1-49e7-b555-3a16a3b2aa35. (HTTP 404) (Request-ID: req-346c926c-ca18-4282-bf3d-0adc172dfc5f)
Nov 08 14:06:07 user nova-compute[87365]: INFO nova.compute.manager [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:07 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Deleted allocations for instance 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6b988c12-710a-4b58-9a94-b1083f103360 tempest-VolumesSnapshotTestJSON-1602758470 tempest-VolumesSnapshotTestJSON-1602758470-project-member] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Acquiring lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "9cbcde5a-dfe9-42b3-853a-f3b25e9acd30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] No waiting events found dispatching network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received unexpected event network-vif-plugged-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 for instance with vm_state deleted and task_state None.
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state building and task_state spawning.
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:07 user nova-compute[87365]: WARNING nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state building and task_state spawning.
Nov 08 14:06:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b3ac2c0-88f8-4d30-9d29-de1800f2c515 req-2bbd2d66-e7be-42c0-b26c-fa497abc5feb service nova] [instance: 9cbcde5a-dfe9-42b3-853a-f3b25e9acd30] Received event network-vif-deleted-4ea00190-d2ee-4a0f-9e96-e86739cb4a95 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:06:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance spawned successfully.
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:06:08 user nova-compute[87365]: INFO nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 08 14:06:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:06:08 user nova-compute[87365]: INFO nova.compute.manager [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Took 7.36 seconds to build instance.
Nov 08 14:06:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-88ec933f-9d66-4944-a125-84c410641e31 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.570s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:11 user nova-compute[87365]: INFO nova.compute.manager [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Terminating instance
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing instance network info cache due to event network-changed-b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] Acquiring lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] Acquired lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.network.neutron [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Refreshing network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-c71b3780-1849-4a21-9712-574ecd63e811 req-80f64816-5cd8-43a8-bffd-90576390453a service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:11 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Instance destroyed successfully.
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lazy-loading 'resources' on Instance uuid 1e894c11-33a8-4e34-be15-277fb1c6f4cd {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updated VIF entry in instance network info cache for port b73e3d43-0bda-475a-a795-d4891abed15e. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [{"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-31c188eb-16c1-4de9-8c4b-9a12a169bf94 req-b750cc23-caf5-41c4-a2aa-77df9c6b0209 service nova] Releasing lock "refresh_cache-1e894c11-33a8-4e34-be15-277fb1c6f4cd" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018597737',display_name='tempest-TestShelveInstance-server-1018597737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018597737',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvwVfqL4qLzUWQBUUD4nfkrkDskpMnlkhIzmkTIWxe1vfMZJQgRizkZHClYYlhrXaEFtwvrzganvNgxa3deH8WFWL5D8JkaZHWuHMKRRlfJtLzLaQVi+6o6N5Cy5go5vg==',key_name='tempest-TestShelveInstance-716194144',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:05:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3523c776dd47cdbae107f85e075ed3',ramdisk_id='',reservation_id='r-e7la5kv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913358462',owner_user_name='tempest-TestShelveInstance-1913358462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:05:00Z,user_data=None,user_id='b64c48aad8f24a63a24044d7e803b2ee',uuid=1e894c11-33a8-4e34-be15-277fb1c6f4cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converting VIF {"id": "b73e3d43-0bda-475a-a795-d4891abed15e", "address": "fa:16:3e:14:5b:13", "network": {"id": "6aa0ab8d-8e28-402e-bda0-490ea1115d85", "bridge": "br-int", "label": "tempest-TestShelveInstance-132444184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3523c776dd47cdbae107f85e075ed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73e3d43-0b", "ovs_interfaceid": "b73e3d43-0bda-475a-a795-d4891abed15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_vif [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73e3d43-0b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea4b023b-9436-4818-a766-cb33e7fa8712) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: INFO os_vif [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:5b:13,bridge_name='br-int',has_traffic_filtering=True,id=b73e3d43-0bda-475a-a795-d4891abed15e,network=Network(6aa0ab8d-8e28-402e-bda0-490ea1115d85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73e3d43-0b')
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvwzQTmE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:06:12 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a003cee-d521-491f-9be6-941aa411db12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:06:12 user nova-compute[87365]: No targets found.
Nov 08 14:06:12 user nova-compute[87365]: iSNS:
Nov 08 14:06:12 user nova-compute[87365]: No targets found.
Nov 08 14:06:12 user nova-compute[87365]: STATIC:
Nov 08 14:06:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec
Nov 08 14:06:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84
Nov 08 14:06:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:06:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:12 user nova-compute[87365]: FIRMWARE:
Nov 08 14:06:12 user nova-compute[87365]: No targets found.
Nov 08 14:06:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:06:12 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:06:12 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ed194-b753-422c-b8e5-4c608085fc94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1c0ad-bc97-4b38-a688-f41aaa2306d4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:12 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:12 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:12 user nova-compute[87365]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec (non-flash)
Nov 08 14:06:12 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4f912d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72a4690-7c8c-482e-bb4f-bb3d0b3988e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.046s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7405cb9c-700b-44c0-9259-37641f603669]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf6777-8399-482d-873c-26e5e194d0bb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209bd87-5914-49cb-be74-7ca45b1b3d6d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_be56c9cd', '/dev/disk/by-id/scsi-1SCST_BIObe56c9cd-573f7fc3b8473561', '/dev/disk/by-id/scsi-23537336637666333') {{(pid=99274) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb44cf-636d-47f1-a3b0-cf09a1d86074]: (4, None) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9464a8f-a990-4d4d-985f-01010909f723]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6d5c2d-29b5-40b4-b99d-464c12ef55fb]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260]
Nov 08 14:06:12 user nova-compute[87365]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec, portal: 172.16.0.220,3260] successful.
Nov 08 14:06:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eae0d4c1-f3c3-4ac8-8919-affeab99faec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32b122-c87b-4244-9f7e-fd9d7c1bb601]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] <== disconnect_volume: return (414ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:06:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deleting instance files /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd_del
Nov 08 14:06:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deletion of /opt/stack/data/nova/instances/1e894c11-33a8-4e34-be15-277fb1c6f4cd_del complete
Nov 08 14:06:12 user nova-compute[87365]: INFO nova.compute.manager [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 08 14:06:12 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:13 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Took 0.61 seconds to deallocate network for instance.
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:13 user nova-compute[87365]: WARNING nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state deleting.
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:13 user nova-compute[87365]: WARNING nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state deleting.
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:13 user nova-compute[87365]: WARNING nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state deleting.
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-unplugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Acquiring lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] No waiting events found dispatching network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:13 user nova-compute[87365]: WARNING nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received unexpected event network-vif-plugged-b73e3d43-0bda-475a-a795-d4891abed15e for instance with vm_state active and task_state deleting.
Nov 08 14:06:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-79731485-843a-4f0c-a07c-0c44534a5320 req-2bfb4f94-e296-4d81-b467-77186a8179cc service nova] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Received event network-vif-deleted-b73e3d43-0bda-475a-a795-d4891abed15e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:14 user nova-compute[87365]: INFO nova.compute.manager [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Took 0.93 seconds to detach 1 volumes for instance.
Nov 08 14:06:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] [instance: 1e894c11-33a8-4e34-be15-277fb1c6f4cd] Deleting volume: eae0d4c1-f3c3-4ac8-8919-affeab99faec {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 14:06:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:14 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:14 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:14 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Deleted allocations for instance 1e894c11-33a8-4e34-be15-277fb1c6f4cd
Nov 08 14:06:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a1b4873e-64ae-4fb6-83e8-7cb95b722c5d tempest-TestShelveInstance-1913358462 tempest-TestShelveInstance-1913358462-project-member] Lock "1e894c11-33a8-4e34-be15-277fb1c6f4cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.453s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:24 user nova-compute[87365]: INFO nova.compute.manager [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Terminating instance
Nov 08 14:06:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-0e3e166e-895d-480a-9617-ac15a98a6bcc req-1e4e261b-2473-4910-9e39-5b016a55fadf service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-unplugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Instance destroyed successfully.
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lazy-loading 'resources' on Instance uuid 8d77f463-f4c6-44a1-94ba-ce5b5e04b257 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T14:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-740798959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-740798959',id=35,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDUBGcqq2BmB+uPwsl58TRaHqM5TXEFZDnV/bYelqjCl/To2qZAK7iYTr1UKVoSxiLBjZBywxCl8mIvUJGEkgD94gW66mSxLnqbfxjph/rfE+ePgPqHzAH0pwjxbEC1BA==',key_name='tempest-keypair-1486094982',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:04:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f9d5da6823541c282006a7871e50ca8',ramdisk_id='',reservation_id='r-ho3z6cn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1136658600',owner_user_name='tempest-AttachVolumeShelveTestJSON-1136658600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ad4efa600524c27a048bd565bf1852c',uuid=8d77f463-f4c6-44a1-94ba-ce5b5e04b257,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converting VIF {"id": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "address": "fa:16:3e:96:f1:3b", "network": {"id": "774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-96821517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f9d5da6823541c282006a7871e50ca8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1757412-0b", "ovs_interfaceid": "b1757412-0b82-41e5-b5ce-f344e9d9f47e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG os_vif [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1757412-0b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e5abd0b-388f-436e-8916-a3b8e66834c1) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:25 user nova-compute[87365]: INFO os_vif [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:3b,bridge_name='br-int',has_traffic_filtering=True,id=b1757412-0b82-41e5-b5ce-f344e9d9f47e,network=Network(774c8c52-efe9-4e58-a2f8-5dfbf7e12f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1757412-0b')
Nov 08 14:06:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Deleting instance files /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257_del
Nov 08 14:06:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Deletion of /opt/stack/data/nova/instances/8d77f463-f4c6-44a1-94ba-ce5b5e04b257_del complete
Nov 08 14:06:25 user nova-compute[87365]: INFO nova.compute.manager [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 14:06:25 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:06:25 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:06:26 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:26 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Took 0.76 seconds to deallocate network for instance.
Nov 08 14:06:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-b272df7f-0eed-4278-970d-d05d6b9412f4 req-16d66c05-12ae-4eaa-9429-0e07ada8ce96 service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-deleted-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:27 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Deleted allocations for instance 8d77f463-f4c6-44a1-94ba-ce5b5e04b257
Nov 08 14:06:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-83d7a10f-b14b-44f7-9645-d01491eae572 tempest-AttachVolumeShelveTestJSON-1136658600 tempest-AttachVolumeShelveTestJSON-1136658600-project-member] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.201s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] Acquiring lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] Lock "8d77f463-f4c6-44a1-94ba-ce5b5e04b257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] No waiting events found dispatching network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:27 user nova-compute[87365]: WARNING nova.compute.manager [req-0a449a0b-f2fd-42b9-953c-934a88340c56 req-2287fcc1-35c8-47af-8be6-48c3d574957e service nova] [instance: 8d77f463-f4c6-44a1-94ba-ce5b5e04b257] Received unexpected event network-vif-plugged-b1757412-0b82-41e5-b5ce-f344e9d9f47e for instance with vm_state deleted and task_state None.
Nov 08 14:06:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:40 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:44 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:44 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:06:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:06:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=24.39173126220703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 41b54c9e-bc8b-4f7b-8203-628370bb251a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 47fe208c-f65d-4054-b464-2962ab2ed947 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:06:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-changed-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Refreshing instance network info cache due to event network-changed-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:06:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] Acquiring lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:06:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] Acquired lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:06:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Refreshing network info cache for port a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updated VIF entry in instance network info cache for port a3bb4bb1-42e6-4237-beae-5f0d902ee6d7. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updating instance_info_cache with network_info: [{"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e36e8496-a7b9-412c-b079-d1a789c7486d req-56e5fa13-a703-4960-9959-bc16c915f6dc service nova] Releasing lock "refresh_cache-47fe208c-f65d-4054-b464-2962ab2ed947" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:50 user nova-compute[87365]: INFO nova.compute.manager [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Terminating instance
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing instance network info cache due to event network-changed-047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] Acquiring lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] Acquired lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Refreshing network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:50 user nova-compute[87365]: INFO nova.compute.manager [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Terminating instance
Nov 08 14:06:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:06:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-unplugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] No waiting events found dispatching network-vif-unplugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-c4520ebb-3ef3-4311-ae45-ef282197e4f4 req-4185cb34-1dfc-4007-872c-b6b35c64eba1 service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-unplugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updated VIF entry in instance network info cache for port 047189fa-55f6-4627-81ee-5ef69ce1d0cf. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [{"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1d6948b0-1400-4f74-91db-2164f6a942a3 req-338cf2b9-e8e9-4c39-99ba-dd2f1fc68a01 service nova] Releasing lock "refresh_cache-41b54c9e-bc8b-4f7b-8203-628370bb251a" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Instance destroyed successfully.
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid 47fe208c-f65d-4054-b464-2962ab2ed947 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:51 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Instance destroyed successfully.
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lazy-loading 'resources' on Instance uuid 41b54c9e-bc8b-4f7b-8203-628370bb251a {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:04:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1896693949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1896693949',id=39,image_ref='70a505f9-1d91-4a52-beec-62e5e4b7c2c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXH7eMQnto+C6h1D3n9R4xklm6QSqjY2M7ztELvYsPBi72OGXpWcN7TqP2tTEmLSMSz1vS27gDsHDms1aMLzQChRQC4xkzwk7/WlGuKLg1xm5Nn9BW4jBhwqxaWB9oU+w==',key_name='tempest-keypair-1681930772',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:05:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-fj2syins',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-596681261',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=47fe208c-f65d-4054-b464-2962ab2ed947,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "address": "fa:16:3e:0b:5c:ab", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3bb4bb1-42", "ovs_interfaceid": "a3bb4bb1-42e6-4237-beae-5f0d902ee6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG os_vif [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:58:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992839902',display_name='tempest-TestStampPattern-server-1992839902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992839902',id=33,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYoeyUV9L7plNVn3TcdCHhUWzm8k2buwp8QeID7/JaTZPkK6S0O5U1BkUjHCE8L58euTXyJ4cVM9qzUhMsA2eoeO0oIkqfWNV/3ceacog+mhm9Sz9ASZfjpowL0hP3eUQ==',key_name='tempest-TestStampPattern-1488310541',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5b55494d4d04b9584f2cd125ebe9b67',ramdisk_id='',reservation_id='r-af108x8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-135387725',owner_user_name='tempest-TestStampPattern-135387725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:02:01Z,user_data=None,user_id='c3e29e071ca349acb9c8f88ff94673f8',uuid=41b54c9e-bc8b-4f7b-8203-628370bb251a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converting VIF {"id": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "address": "fa:16:3e:4d:05:52", "network": {"id": "bba23294-5069-4792-a41a-d82aa1d4c9e7", "bridge": "br-int", "label": "tempest-TestStampPattern-2142125933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b55494d4d04b9584f2cd125ebe9b67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap047189fa-55", "ovs_interfaceid": "047189fa-55f6-4627-81ee-5ef69ce1d0cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG os_vif [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap047189fa-55, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3bb4bb1-42, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab9bfa80-f83b-4a71-9a22-d5a8d7a071b3) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a407396-9737-43f9-a3a2-58ad9f03b72c) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:06:51 user nova-compute[87365]: INFO os_vif [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:05:52,bridge_name='br-int',has_traffic_filtering=True,id=047189fa-55f6-4627-81ee-5ef69ce1d0cf,network=Network(bba23294-5069-4792-a41a-d82aa1d4c9e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap047189fa-55')
Nov 08 14:06:51 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Deleting instance files /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a_del
Nov 08 14:06:51 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Deletion of /opt/stack/data/nova/instances/41b54c9e-bc8b-4f7b-8203-628370bb251a_del complete
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:06:51 user nova-compute[87365]: INFO os_vif [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:5c:ab,bridge_name='br-int',has_traffic_filtering=True,id=a3bb4bb1-42e6-4237-beae-5f0d902ee6d7,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3bb4bb1-42')
Nov 08 14:06:51 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMnEKeRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:06:51 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:06:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:06:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114ba13-10c2-4592-8cf5-913b426fbb52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:06:52 user nova-compute[87365]: No targets found.
Nov 08 14:06:52 user nova-compute[87365]: iSNS:
Nov 08 14:06:52 user nova-compute[87365]: No targets found.
Nov 08 14:06:52 user nova-compute[87365]: STATIC:
Nov 08 14:06:52 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84
Nov 08 14:06:52 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:52 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:52 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:06:52 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:06:52 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:06:52 user nova-compute[87365]: FIRMWARE:
Nov 08 14:06:52 user nova-compute[87365]: No targets found.
Nov 08 14:06:52 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:06:52 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:06:52 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c89bc87-3ddd-4c6e-9766-904ffea5ee49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c25982-0335-48e8-93b3-ad8d7ea0bccf]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:52 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:52 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:06:52 user nova-compute[87365]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 (non-flash)
Nov 08 14:06:52 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d24e1b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: INFO nova.compute.manager [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd498c4b-35a3-4399-a75b-d308da4a1fbc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040497d-6d91-41c6-93c2-c755b0842144]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb789935-65e1-44d5-adc0-28a138f46914]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f44e8c4-784e-44dc-a75a-cebdc712cd74]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2fa7b2-3a1e-4f5f-b678-2772692c7ed3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0548e475-5ec3-4366-8db2-1e87daf5ea14]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260]
Nov 08 14:06:52 user nova-compute[87365]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84, portal: 172.16.0.220,3260] successful.
Nov 08 14:06:52 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66bee54-cb73-4d39-8db3-13245aa79a84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cac69-c28c-46e3-97f7-1b5715afbcb0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (369ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:06:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Deleting instance files /opt/stack/data/nova/instances/47fe208c-f65d-4054-b464-2962ab2ed947_del
Nov 08 14:06:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Deletion of /opt/stack/data/nova/instances/47fe208c-f65d-4054-b464-2962ab2ed947_del complete
Nov 08 14:06:52 user nova-compute[87365]: INFO nova.compute.manager [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 08 14:06:52 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Acquiring lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "47fe208c-f65d-4054-b464-2962ab2ed947-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] No waiting events found dispatching network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:53 user nova-compute[87365]: WARNING nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received unexpected event network-vif-plugged-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 for instance with vm_state active and task_state deleting.
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-unplugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-unplugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-unplugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:53 user nova-compute[87365]: WARNING nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state active and task_state deleting.
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:53 user nova-compute[87365]: WARNING nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state active and task_state deleting.
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:53 user nova-compute[87365]: WARNING nova.compute.manager [req-30d26d47-c3ad-4fe8-a31b-e44f14b07aef req-7cfc5664-13c2-4238-8428-8e7a2fb32c1a service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state active and task_state deleting.
Nov 08 14:06:53 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:53 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Took 1.53 seconds to deallocate network for instance.
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:54 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:06:54 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:54 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Took 1.61 seconds to deallocate network for instance.
Nov 08 14:06:54 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:54 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Deleted allocations for instance 41b54c9e-bc8b-4f7b-8203-628370bb251a
Nov 08 14:06:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c09308ce-e0a5-49bb-9df4-0d62142145cb tempest-TestStampPattern-135387725 tempest-TestStampPattern-135387725-project-member] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.370s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:55 user nova-compute[87365]: INFO nova.compute.manager [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Took 1.00 seconds to detach 1 volumes for instance.
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Deleting volume: e66bee54-cb73-4d39-8db3-13245aa79a84 {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] Acquiring lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] Lock "41b54c9e-bc8b-4f7b-8203-628370bb251a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] No waiting events found dispatching network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:06:55 user nova-compute[87365]: WARNING nova.compute.manager [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received unexpected event network-vif-plugged-047189fa-55f6-4627-81ee-5ef69ce1d0cf for instance with vm_state deleted and task_state None.
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] [instance: 41b54c9e-bc8b-4f7b-8203-628370bb251a] Received event network-vif-deleted-047189fa-55f6-4627-81ee-5ef69ce1d0cf {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-e5ee5e92-eaad-4619-9243-aca339f34d0a req-afe6a500-2f1b-43ca-9f57-8e54e0a38efd service nova] [instance: 47fe208c-f65d-4054-b464-2962ab2ed947] Received event network-vif-deleted-a3bb4bb1-42e6-4237-beae-5f0d902ee6d7 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:55 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance 47fe208c-f65d-4054-b464-2962ab2ed947
Nov 08 14:06:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c035e0fe-21b6-4222-9649-8dd454b47b29 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "47fe208c-f65d-4054-b464-2962ab2ed947" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.065s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:06:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:06:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:07:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:07:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:33 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:41 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:07:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:07:47 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=24.39891815185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:07:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:07:48 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-changed-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Refreshing instance network info cache due to event network-changed-37bcfa01-a258-4259-8c18-44119de8d394. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:07:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Refreshing network info cache for port 37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:07:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updated VIF entry in instance network info cache for port 37bcfa01-a258-4259-8c18-44119de8d394. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:07:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:07:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3319352e-b6fd-4d46-8720-0abab8f74285 req-f2d8a0d1-a00a-4974-bf10-35297a5a254a service nova] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:54 user nova-compute[87365]: INFO nova.compute.manager [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Terminating instance
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-unplugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] No waiting events found dispatching network-vif-unplugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.compute.manager [req-0db63673-3792-4563-bbfa-8670f4ee3a1a req-a34641b9-b79a-474a-a299-33cd33e2d7ff service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-unplugged-ac7f756d-68e9-4e55-b348-f861229f7f63 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:07:54 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Instance destroyed successfully.
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-430803022',display_name='tempest-TestVolumeBootPattern-volume-backed-server-430803022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-430803022',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrrucU/zBexje0ipFJEOZ2ZWG932XyIwE9wm38QH9BUjZpwjQy0OXfg3KWkUXDjVr2D+WlSi6ePoVcSf1PGTCH7MCoeQsbOWKcHzybPmB7/VP6gqegn6Xv2UCe/5CI6aA==',key_name='tempest-keypair-1654793552',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-4mi0qcop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19773693ca345709379304f9e6f0772',uuid=c4220fe0-5f26-42c7-bd5b-c17c8852ceb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "ac7f756d-68e9-4e55-b348-f861229f7f63", "address": "fa:16:3e:84:a6:e3", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f756d-68", "ovs_interfaceid": "ac7f756d-68e9-4e55-b348-f861229f7f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG os_vif [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac7f756d-68, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee0b0963-bac8-46ca-8779-8583b8d0b8a8) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:07:54 user nova-compute[87365]: INFO os_vif [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:a6:e3,bridge_name='br-int',has_traffic_filtering=True,id=ac7f756d-68e9-4e55-b348-f861229f7f63,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f756d-68')
Nov 08 14:07:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYOmbQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:07:54 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:07:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:07:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[defcae81-1e2d-4bb9-80a8-067ae15b6a13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:07:55 user nova-compute[87365]: No targets found.
Nov 08 14:07:55 user nova-compute[87365]: iSNS:
Nov 08 14:07:55 user nova-compute[87365]: No targets found.
Nov 08 14:07:55 user nova-compute[87365]: STATIC:
Nov 08 14:07:55 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30
Nov 08 14:07:55 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:07:55 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:07:55 user nova-compute[87365]: FIRMWARE:
Nov 08 14:07:55 user nova-compute[87365]: No targets found.
Nov 08 14:07:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:07:55 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:07:55 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b4660-36ad-46c0-8073-3a8030d8ec7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f1f747-1a2c-4d83-8134-6cb342d5fbfb]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:07:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 (non-flash)
Nov 08 14:07:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d24e1b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b2abf-e3e6-4ac9-9308-11e28c01c570]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[44435e71-bfb6-46c2-b0d0-7d5efaf3e030]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d53bd2-875a-427c-a851-5d12b1371d03]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1353f1-44ba-490b-82a5-b14051d917d1]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b97050-7a21-4e79-aa88-1b4f8bac9a35]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[48849eed-e1d2-4d7e-b7ab-bee75ff8a7d1]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260]
Nov 08 14:07:55 user nova-compute[87365]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30, portal: 172.16.0.220,3260] successful.
Nov 08 14:07:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acfc132-d0c7-415a-9acc-f40bd8af5a30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4899ba3-bd7f-460d-ac6f-c353cedb3801]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (392ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:07:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Deleting instance files /opt/stack/data/nova/instances/c4220fe0-5f26-42c7-bd5b-c17c8852ceb9_del
Nov 08 14:07:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Deletion of /opt/stack/data/nova/instances/c4220fe0-5f26-42c7-bd5b-c17c8852ceb9_del complete
Nov 08 14:07:55 user nova-compute[87365]: INFO nova.compute.manager [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 08 14:07:55 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:07:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] Acquiring lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] No waiting events found dispatching network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:07:56 user nova-compute[87365]: WARNING nova.compute.manager [req-fecccc98-06aa-4bef-870e-66758cfe04ba req-ed7fd7f3-550e-4eac-9762-b01041452f1d service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received unexpected event network-vif-plugged-ac7f756d-68e9-4e55-b348-f861229f7f63 for instance with vm_state active and task_state deleting.
Nov 08 14:07:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:57 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:07:57 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Took 1.77 seconds to deallocate network for instance.
Nov 08 14:07:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-3eeb8989-8d34-4fed-9906-7c4c6b14ad38 req-ece1e067-b99e-4e01-9e77-5241d363900c service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Received event network-vif-deleted-ac7f756d-68e9-4e55-b348-f861229f7f63 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:07:57 user nova-compute[87365]: INFO nova.compute.manager [req-3eeb8989-8d34-4fed-9906-7c4c6b14ad38 req-ece1e067-b99e-4e01-9e77-5241d363900c service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Neutron deleted interface ac7f756d-68e9-4e55-b348-f861229f7f63; detaching it from the instance and deleting it from the info cache
Nov 08 14:07:57 user nova-compute[87365]: DEBUG nova.network.neutron [req-3eeb8989-8d34-4fed-9906-7c4c6b14ad38 req-ece1e067-b99e-4e01-9e77-5241d363900c service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:07:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-3eeb8989-8d34-4fed-9906-7c4c6b14ad38 req-ece1e067-b99e-4e01-9e77-5241d363900c service nova] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Detach interface failed, port_id=ac7f756d-68e9-4e55-b348-f861229f7f63, reason: Instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:07:58 user nova-compute[87365]: INFO nova.compute.manager [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Took 1.21 seconds to detach 1 volumes for instance.
Nov 08 14:07:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: c4220fe0-5f26-42c7-bd5b-c17c8852ceb9] Deleting volume: 2acfc132-d0c7-415a-9acc-f40bd8af5a30 {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:07:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:58 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance c4220fe0-5f26-42c7-bd5b-c17c8852ceb9
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f6938893-f291-410a-bbf1-1c467f1d067e tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "c4220fe0-5f26-42c7-bd5b-c17c8852ceb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.902s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:07:59 user nova-compute[87365]: INFO nova.compute.manager [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Attaching volume 691a6d7e-03af-47cf-b7a8-16414ed7f389 to /dev/vdb
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.utils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dc552e-5096-47af-ab88-808bb36f8aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79077ece-1e71-4f77-803b-b2fde70cae3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede40d5f-bb9a-4a34-84d7-a9e487fe0433]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[176df282-ff1b-4e9f-8363-158e5fe4f8e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:07:59 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:07:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f78759c-e42a-48d8-80a8-7298e2462bbc]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG os_brick.utils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating existing volume attachment record: d32ecaa8-3ef8-4e56-a861-02cbb53e02c9 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:07:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:08:24 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:08:24 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:08:24 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c538c5b-6b20-492b-8aca-6fbeb7cc228f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:08:24 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed302def-e27b-498b-81d3-2da36df8874f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389] added
Nov 08 14:08:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d2b231-27cb-4476-a874-bf0e1006eef5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[758e3e29-bfab-4852-892b-25a6c783fb86]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjDKqTOG {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjDKqTOG" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4af2d-9e4e-46ac-84e8-428c87e3e0f7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tjDKqTOG'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[24753dc3-f581-4811-b457-397dfcfc0e1d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8aa410-17df-40bc-bbc2-d034a63738f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:08:24 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:08:24 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:08:24 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:08:24 user nova-compute[87365]: 
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee05633-c9ff-4b2e-8616-75c953e1bc73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]
Nov 08 14:08:24 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.
Nov 08 14:08:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7f1fe-a91b-4c88-a357-0ff78fa52d52]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756ed14-396a-4303-b83c-590e9aeb7e39]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:08:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:08:24 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b9279-e072-4cbf-85d0-a9dea1735c20]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:08:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26431303135316233', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431303135316233', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:08:25 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:08:25 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:08:25 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:08:25 user nova-compute[87365]:   <serial>691a6d7e-03af-47cf-b7a8-16414ed7f389</serial>
Nov 08 14:08:25 user nova-compute[87365]: </disk>
Nov 08 14:08:25 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:08:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No VIF found with MAC fa:16:3e:65:e2:8a, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ff37fcd5-93be-4909-ab1c-e713d4bb39b6 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.708s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=87365) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG nova.objects.instance [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance destroyed successfully.
Nov 08 14:08:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:08:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-757dfc68-c53b-4c8a-90b8-c6a5bf31fc38 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.970s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:08:29 user nova-compute[87365]: INFO nova.compute.claims [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Claim successful on node user
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:08:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:08:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:08:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG nova.policy [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f500e55fac46c59f38b0cd17172299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58ecaf473940859738817c8a91b64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:08:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Creating image(s)
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "/opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk 1073741824" returned: 0 in 0.055s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Successfully created port: 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.266s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:08:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Cannot resize image /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Ensure instance console log exists: /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:08:32 user nova-compute[87365]: WARNING nova.compute.manager [req-d304cc05-8bdb-4b4b-bb77-4897a3010c43 req-e1425eda-4c0e-4cf6-80d5-e6ce27759da0 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state stopped and task_state None.
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Successfully updated port: 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquired lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.neutron [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating instance_info_cache with network_info: [{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Releasing lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Instance network_info: |[{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Start _get_guest_xml network_info=[{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:08:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:08:32 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-895395451',display_name='tempest-AttachVolumeNegativeTest-server-895395451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-895395451',id=41,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCypJ2pRpmLk/NcTcN4BaIi1lf1/EKCNOyOpzr7c3pCCfYD/TOSSOG645dB3srRlPrqpNC7m6pWPGa8UGV3xvGq6qi1JRLIsGF+wn/jTDsKivFQj6SPR5Cp+GJNRFhhxVQ==',key_name='tempest-keypair-778207359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-kfl6ao0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=8449ebf2-af28-4fa2-8d18-5550729f9e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.objects.instance [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'pci_devices' on Instance uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:08:32 user nova-compute[87365]:   <uuid>8449ebf2-af28-4fa2-8d18-5550729f9e93</uuid>
Nov 08 14:08:32 user nova-compute[87365]:   <name>instance-00000029</name>
Nov 08 14:08:32 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:08:32 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:08:32 user nova-compute[87365]:   <metadata>
Nov 08 14:08:32 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:08:32 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeNegativeTest-server-895395451</nova:name>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:08:32</nova:creationTime>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:08:32 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:08:32 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:owner>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:user uuid="25f500e55fac46c59f38b0cd17172299">tempest-AttachVolumeNegativeTest-1316129282-project-member</nova:user>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:project uuid="3e58ecaf473940859738817c8a91b64c">tempest-AttachVolumeNegativeTest-1316129282</nova:project>
Nov 08 14:08:32 user nova-compute[87365]:       </nova:owner>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:08:32 user nova-compute[87365]:       <nova:ports>
Nov 08 14:08:32 user nova-compute[87365]:         <nova:port uuid="9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab">
Nov 08 14:08:32 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:08:32 user nova-compute[87365]:         </nova:port>
Nov 08 14:08:32 user nova-compute[87365]:       </nova:ports>
Nov 08 14:08:32 user nova-compute[87365]:     </nova:instance>
Nov 08 14:08:32 user nova-compute[87365]:   </metadata>
Nov 08 14:08:32 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:08:32 user nova-compute[87365]:     <system>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="serial">8449ebf2-af28-4fa2-8d18-5550729f9e93</entry>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="uuid">8449ebf2-af28-4fa2-8d18-5550729f9e93</entry>
Nov 08 14:08:32 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:08:32 user nova-compute[87365]:     </system>
Nov 08 14:08:32 user nova-compute[87365]:   </sysinfo>
Nov 08 14:08:32 user nova-compute[87365]:   <os>
Nov 08 14:08:32 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:08:32 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:08:32 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:08:32 user nova-compute[87365]:   </os>
Nov 08 14:08:32 user nova-compute[87365]:   <features>
Nov 08 14:08:32 user nova-compute[87365]:     <acpi/>
Nov 08 14:08:32 user nova-compute[87365]:     <apic/>
Nov 08 14:08:32 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:08:32 user nova-compute[87365]:   </features>
Nov 08 14:08:32 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:08:32 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:08:32 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:08:32 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:08:32 user nova-compute[87365]:   </clock>
Nov 08 14:08:32 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:08:32 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:08:32 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:08:32 user nova-compute[87365]:   </cpu>
Nov 08 14:08:32 user nova-compute[87365]:   <devices>
Nov 08 14:08:32 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:08:32 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:08:32 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk"/>
Nov 08 14:08:32 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:08:32 user nova-compute[87365]:     </disk>
Nov 08 14:08:32 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:08:32 user nova-compute[87365]:       <mac address="fa:16:3e:39:47:c2"/>
Nov 08 14:08:32 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:08:32 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:08:32 user nova-compute[87365]:       <target dev="tap9e6cecff-e0"/>
Nov 08 14:08:32 user nova-compute[87365]:     </interface>
Nov 08 14:08:32 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:08:32 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/console.log" append="off"/>
Nov 08 14:08:32 user nova-compute[87365]:     </serial>
Nov 08 14:08:32 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:08:32 user nova-compute[87365]:     <video>
Nov 08 14:08:32 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:08:32 user nova-compute[87365]:     </video>
Nov 08 14:08:32 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:08:32 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:08:32 user nova-compute[87365]:     </rng>
Nov 08 14:08:32 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:08:32 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:08:32 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:08:32 user nova-compute[87365]:     </memballoon>
Nov 08 14:08:32 user nova-compute[87365]:   </devices>
Nov 08 14:08:32 user nova-compute[87365]: </domain>
Nov 08 14:08:32 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-895395451',display_name='tempest-AttachVolumeNegativeTest-server-895395451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-895395451',id=41,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCypJ2pRpmLk/NcTcN4BaIi1lf1/EKCNOyOpzr7c3pCCfYD/TOSSOG645dB3srRlPrqpNC7m6pWPGa8UGV3xvGq6qi1JRLIsGF+wn/jTDsKivFQj6SPR5Cp+GJNRFhhxVQ==',key_name='tempest-keypair-778207359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-kfl6ao0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=8449ebf2-af28-4fa2-8d18-5550729f9e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG os_vif [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4530e26a-5ac4-56f9-bb96-82b4cb47f5a5', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e6cecff-e0, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e6cecff-e0, col_values=(('qos', UUID('54ba4707-c125-4f4d-b2a2-7164d6948883')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e6cecff-e0, col_values=(('external_ids', {'iface-id': '9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:47:c2', 'vm-uuid': '8449ebf2-af28-4fa2-8d18-5550729f9e93'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:32 user nova-compute[87365]: INFO os_vif [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0')
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:08:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:39:47:c2, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-changed-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Refreshing instance network info cache due to event network-changed-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Acquiring lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Acquired lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.network.neutron [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Refreshing network info cache for port 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] No waiting events found dispatching network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:08:34 user nova-compute[87365]: WARNING nova.compute.manager [req-03d7887b-e3ad-493b-a842-99ba4469c6ee req-cb14e2e1-0386-4d3a-bdd7-60406822de8e service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received unexpected event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab for instance with vm_state building and task_state spawning.
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.network.neutron [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updated VIF entry in instance network info cache for port 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.network.neutron [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating instance_info_cache with network_info: [{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Releasing lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:08:34 user nova-compute[87365]: WARNING nova.compute.manager [req-155b4942-d3a3-4dc7-880f-a3aec2c449e2 req-699b634b-bfab-48c5-9884-10ac601654f3 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state stopped and task_state None.
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:35 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:08:36 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Instance spawned successfully.
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] No waiting events found dispatching network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:08:36 user nova-compute[87365]: WARNING nova.compute.manager [req-8477a48d-2bff-46d2-adfb-a9077659877f req-5e995ccc-c3ba-4a22-80d0-21dfa117bbe3 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received unexpected event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab for instance with vm_state building and task_state spawning.
Nov 08 14:08:36 user nova-compute[87365]: INFO nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Took 6.41 seconds to spawn the instance on the hypervisor.
Nov 08 14:08:36 user nova-compute[87365]: DEBUG nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:08:36 user nova-compute[87365]: INFO nova.compute.manager [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Took 7.28 seconds to build instance.
Nov 08 14:08:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34eb710a-16c3-4e85-9399-cd01c4e06db3 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.438s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:43 user nova-compute[87365]: INFO nova.compute.manager [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Terminating instance
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] During wait destroy, instance disappeared. {{(pid=87365) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 08 14:08:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Instance destroyed successfully.
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'resources' on Instance uuid 7f48b991-bd55-400d-ac6a-5ed4f976b6a0 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T13:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-978346557',display_name='tempest-ServerActionsTestOtherA-server-717355324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-978346557',id=16,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXssOCN6l/BHRW8eYhwE/+KFpIm6yZAz+7PkYmeevUzCp4InPVQp+u9pz8vhJDmHM4iGSRQguFaolJQxr0wTymCCCouBr7rmsCpZbHhdxLPc17+hEnzAvYx6PBQWGBzRQ==',key_name='tempest-keypair-1114508957',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-vdqtxa2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=7f48b991-bd55-400d-ac6a-5ed4f976b6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "8487e943-4746-43ff-93db-f364699a6d3c", "address": "fa:16:3e:bf:dc:3f", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8487e943-47", "ovs_interfaceid": "8487e943-4746-43ff-93db-f364699a6d3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_vif [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8487e943-47, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:08:43 user nova-compute[87365]: INFO os_vif [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:dc:3f,bridge_name='br-int',has_traffic_filtering=True,id=8487e943-4746-43ff-93db-f364699a6d3c,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8487e943-47')
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuKxHFaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:08:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6015a-a9fb-4869-9e82-8bcb39e01c70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:08:43 user nova-compute[87365]: No targets found.
Nov 08 14:08:43 user nova-compute[87365]: iSNS:
Nov 08 14:08:43 user nova-compute[87365]: No targets found.
Nov 08 14:08:43 user nova-compute[87365]: STATIC:
Nov 08 14:08:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389
Nov 08 14:08:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:08:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:08:43 user nova-compute[87365]: FIRMWARE:
Nov 08 14:08:43 user nova-compute[87365]: No targets found.
Nov 08 14:08:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:08:43 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:08:43 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a344022d-2014-47c0-b9dd-bef0aff0460a', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fa96f6-a607-46c8-ba02-9e35ef70a3b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ccf1ca-ad8b-4c0d-81ff-6490963a1f8c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:08:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:08:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4c65900>, {}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Disconnecting from: [] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== disconnect_volume: return (81ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:08:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Deletion of /opt/stack/data/nova/instances/7f48b991-bd55-400d-ac6a-5ed4f976b6a0_del complete
Nov 08 14:08:43 user nova-compute[87365]: INFO nova.compute.manager [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Took 0.21 seconds to destroy the instance on the hypervisor.
Nov 08 14:08:43 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:08:43 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:08:44 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:08:44 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Took 0.70 seconds to deallocate network for instance.
Nov 08 14:08:44 user nova-compute[87365]: DEBUG nova.compute.manager [req-abd9dabb-74c7-46f7-bf61-75a87a841d6c req-86a608c0-3323-4b62-8ba6-11c73232bf88 service nova] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Received event network-vif-deleted-8487e943-4746-43ff-93db-f364699a6d3c {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:08:44 user nova-compute[87365]: INFO nova.compute.manager [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: 7f48b991-bd55-400d-ac6a-5ed4f976b6a0] Took 0.11 seconds to detach 1 volumes for instance.
Nov 08 14:08:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:44 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:44 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:08:44 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:08:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-49798a6c-3504-4742-b49c-a7e16b54e5f9 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "7f48b991-bd55-400d-ac6a-5ed4f976b6a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.582s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:08:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4010-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:08:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:08:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:08:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8287MB free_disk=24.38373565673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:08:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:08:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:50 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:08:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:08:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:08:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [{"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-1f33375d-af45-4ce6-b51d-18cbcf50b723" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:08:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:08:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:08:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:09 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:09:09 user nova-compute[87365]: INFO nova.compute.claims [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Claim successful on node user
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:09:10 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:09:10 user nova-compute[87365]: INFO nova.virt.block_device [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Booting with volume d90fff52-7c64-4e39-9bf3-2c77bef47d64 at /dev/vda
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.policy [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4e26d7-680a-4a76-a405-79c47d42e63a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9246aa1b-bd16-419d-b330-7ed7820fb1fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e30e6-f611-425a-9248-ce3dbe8f4c25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8882a4dc-4088-41cd-97c4-70f7fd988147]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:09:10 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:09:10 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439aaf4-2ea5-44a1-881f-e1aa8ecb347f]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG os_brick.utils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:09:10 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updating existing volume attachment record: 090adbf1-ef4f-4a4e-99c6-e82a6c0ecc4b {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:09:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:11 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Successfully created port: d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:09:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Successfully updated port: d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-changed-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Refreshing instance network info cache due to event network-changed-d7bd50e3-09b6-4bb1-876c-28bbc5caa016. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] Acquiring lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updating instance_info_cache with network_info: [{"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Instance network_info: |[{"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] Acquired lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Refreshing network info cache for port d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updated VIF entry in instance network info cache for port d7bd50e3-09b6-4bb1-876c-28bbc5caa016. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updating instance_info_cache with network_info: [{"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:09:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-58b59515-71c8-46d5-975e-50b0a9a58f38 req-4725ce01-b59f-49b3-bffc-3d2624b3a172 service nova] Releasing lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:09:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:09:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:34 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:09:34 user nova-compute[87365]: INFO nova.compute.claims [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Claim successful on node user
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:09:35 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.policy [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '977805499d10433a8eef4c91d04dabf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972331944149427c988c65d7292663a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:09:35 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Creating image(s)
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "/opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "/opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.221s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk 1073741824" returned: 0 in 0.068s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Successfully created port: 51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Cannot resize image /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Ensure instance console log exists: /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Successfully updated port: 51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquired lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:09:36 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-changed-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Refreshing instance network info cache due to event network-changed-51d6cd01-6d74-4edb-8515-5c4fa186f861. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] Acquiring lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.neutron [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating instance_info_cache with network_info: [{"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Releasing lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Instance network_info: |[{"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] Acquired lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Refreshing network info cache for port 51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Start _get_guest_xml network_info=[{"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:09:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1843809769',display_name='tempest-TestServerVolumeAttachmentScenario-server-1843809769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1843809769',id=43,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl/nVBWmIrXpDicXzzyyHfcGqmeCJ8Tz1bqfbM9IJWkUFhGVv/8/A4XI3zYaddH5nYoTFXHBtsVU7iGxQ70dnn+ixg7WokfmupTVtcorJQTbgOBxCeKGDUE4iIkYegZkw==',key_name='tempest-keypair-137767196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972331944149427c988c65d7292663a4',ramdisk_id='',reservation_id='r-25cg4jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-905729236',owner_user_name='tempest-TestServerVolumeAttachmentScenario-905729236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977805499d10433a8eef4c91d04dabf2',uuid=0d1e3f3b-3789-44d0-853a-d8e886a536f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converting VIF {"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.objects.instance [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:09:37 user nova-compute[87365]:   <uuid>0d1e3f3b-3789-44d0-853a-d8e886a536f7</uuid>
Nov 08 14:09:37 user nova-compute[87365]:   <name>instance-0000002b</name>
Nov 08 14:09:37 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:09:37 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:09:37 user nova-compute[87365]:   <metadata>
Nov 08 14:09:37 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:09:37 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1843809769</nova:name>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:09:37</nova:creationTime>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:09:37 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:09:37 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:owner>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:user uuid="977805499d10433a8eef4c91d04dabf2">tempest-TestServerVolumeAttachmentScenario-905729236-project-member</nova:user>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:project uuid="972331944149427c988c65d7292663a4">tempest-TestServerVolumeAttachmentScenario-905729236</nova:project>
Nov 08 14:09:37 user nova-compute[87365]:       </nova:owner>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:09:37 user nova-compute[87365]:       <nova:ports>
Nov 08 14:09:37 user nova-compute[87365]:         <nova:port uuid="51d6cd01-6d74-4edb-8515-5c4fa186f861">
Nov 08 14:09:37 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 14:09:37 user nova-compute[87365]:         </nova:port>
Nov 08 14:09:37 user nova-compute[87365]:       </nova:ports>
Nov 08 14:09:37 user nova-compute[87365]:     </nova:instance>
Nov 08 14:09:37 user nova-compute[87365]:   </metadata>
Nov 08 14:09:37 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:09:37 user nova-compute[87365]:     <system>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="serial">0d1e3f3b-3789-44d0-853a-d8e886a536f7</entry>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="uuid">0d1e3f3b-3789-44d0-853a-d8e886a536f7</entry>
Nov 08 14:09:37 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:09:37 user nova-compute[87365]:     </system>
Nov 08 14:09:37 user nova-compute[87365]:   </sysinfo>
Nov 08 14:09:37 user nova-compute[87365]:   <os>
Nov 08 14:09:37 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:09:37 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:09:37 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:09:37 user nova-compute[87365]:   </os>
Nov 08 14:09:37 user nova-compute[87365]:   <features>
Nov 08 14:09:37 user nova-compute[87365]:     <acpi/>
Nov 08 14:09:37 user nova-compute[87365]:     <apic/>
Nov 08 14:09:37 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:09:37 user nova-compute[87365]:   </features>
Nov 08 14:09:37 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:09:37 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:09:37 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:09:37 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:09:37 user nova-compute[87365]:   </clock>
Nov 08 14:09:37 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:09:37 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:09:37 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:09:37 user nova-compute[87365]:   </cpu>
Nov 08 14:09:37 user nova-compute[87365]:   <devices>
Nov 08 14:09:37 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:09:37 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:09:37 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk"/>
Nov 08 14:09:37 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:09:37 user nova-compute[87365]:     </disk>
Nov 08 14:09:37 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:09:37 user nova-compute[87365]:       <mac address="fa:16:3e:5f:9b:43"/>
Nov 08 14:09:37 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:09:37 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:09:37 user nova-compute[87365]:       <target dev="tap51d6cd01-6d"/>
Nov 08 14:09:37 user nova-compute[87365]:     </interface>
Nov 08 14:09:37 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:09:37 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/console.log" append="off"/>
Nov 08 14:09:37 user nova-compute[87365]:     </serial>
Nov 08 14:09:37 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:09:37 user nova-compute[87365]:     <video>
Nov 08 14:09:37 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:09:37 user nova-compute[87365]:     </video>
Nov 08 14:09:37 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:09:37 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:09:37 user nova-compute[87365]:     </rng>
Nov 08 14:09:37 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:09:37 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:09:37 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:09:37 user nova-compute[87365]:     </memballoon>
Nov 08 14:09:37 user nova-compute[87365]:   </devices>
Nov 08 14:09:37 user nova-compute[87365]: </domain>
Nov 08 14:09:37 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1843809769',display_name='tempest-TestServerVolumeAttachmentScenario-server-1843809769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1843809769',id=43,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl/nVBWmIrXpDicXzzyyHfcGqmeCJ8Tz1bqfbM9IJWkUFhGVv/8/A4XI3zYaddH5nYoTFXHBtsVU7iGxQ70dnn+ixg7WokfmupTVtcorJQTbgOBxCeKGDUE4iIkYegZkw==',key_name='tempest-keypair-137767196',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972331944149427c988c65d7292663a4',ramdisk_id='',reservation_id='r-25cg4jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-905729236',owner_user_name='tempest-TestServerVolumeAttachmentScenario-905729236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977805499d10433a8eef4c91d04dabf2',uuid=0d1e3f3b-3789-44d0-853a-d8e886a536f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converting VIF {"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_vif [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a038a48-a1ae-5556-84df-a3445d28dafd', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51d6cd01-6d, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51d6cd01-6d, col_values=(('qos', UUID('6b1f964f-da88-4886-9381-4f599ae69f4e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51d6cd01-6d, col_values=(('external_ids', {'iface-id': '51d6cd01-6d74-4edb-8515-5c4fa186f861', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9b:43', 'vm-uuid': '0d1e3f3b-3789-44d0-853a-d8e886a536f7'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:37 user nova-compute[87365]: INFO os_vif [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d')
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:09:37 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Creating image(s)
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Ensure instance console log exists: /opt/stack/data/nova/instances/e437c171-4346-498a-abbb-030e7c952d91/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Start _get_guest_xml network_info=[{"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e437c171-4346-498a-abbb-030e7c952d91', 'attached_at': '', 'detached_at': '', 'volume_id': 'd90fff52-7c64-4e39-9bf3-2c77bef47d64', 'serial': 'd90fff52-7c64-4e39-9bf3-2c77bef47d64'}, 'attachment_id': '090adbf1-ef4f-4a4e-99c6-e82a6c0ecc4b', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No VIF found with MAC fa:16:3e:5f:9b:43, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:09:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:37 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:09:37 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:09:37 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:09:37 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f9b0f-1414-402e-a46b-ae1e4590abb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:09:37 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a76a48-0057-4eef-99b2-5943f548974e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64] added
Nov 08 14:09:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c7479-5775-4867-bbff-09a22d8b620a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66d66b-f2fe-41eb-b4e8-85487544e250]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMBjURLa {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMBjURLa" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8464973b-7e0c-4a3d-ba34-66065943b209]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMBjURLa'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc629f-f00a-4625-9756-b6e73f013e9b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc72c8-5b34-4c77-b604-1a1353fac618]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:09:37 user nova-compute[87365]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)
Nov 08 14:09:37 user nova-compute[87365]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)
Nov 08 14:09:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:09:37 user nova-compute[87365]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)
Nov 08 14:09:37 user nova-compute[87365]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)
Nov 08 14:09:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ec981-be86-4f74-8341-5a272ea5ab2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]
Nov 08 14:09:37 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.
Nov 08 14:09:37 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:37 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4e0c8-668e-407f-a592-48a4e611115d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f16239-4298-44db-891d-57b3333d4c72]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1462a4a7-a43c-482f-8932-8427d45952bf (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2feff835-00f6-4eb2-86ac-ecbdd2071483 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:09:38 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updated VIF entry in instance network info cache for port 51d6cd01-6d74-4edb-8515-5c4fa186f861. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating instance_info_cache with network_info: [{"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d33efb-e7f0-4bdb-8d29-516abc92dfe9]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b402cbf0-3960-4a5e-b91b-e39eb78ed6ee req-21f71486-7a47-486f-8417-dc75c2db8e74 service nova] Releasing lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:09:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23336663033333263', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336663033333263', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141171971',display_name='tempest-TestVolumeBootPattern-server-141171971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141171971',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-g734x75f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:09:11Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=e437c171-4346-498a-abbb-030e7c952d91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.objects.instance [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid e437c171-4346-498a-abbb-030e7c952d91 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:09:39 user nova-compute[87365]:   <uuid>e437c171-4346-498a-abbb-030e7c952d91</uuid>
Nov 08 14:09:39 user nova-compute[87365]:   <name>instance-0000002a</name>
Nov 08 14:09:39 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:09:39 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:09:39 user nova-compute[87365]:   <metadata>
Nov 08 14:09:39 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:09:39 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:09:39 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-server-141171971</nova:name>
Nov 08 14:09:39 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:09:37</nova:creationTime>
Nov 08 14:09:39 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:09:39 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:09:39 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:09:39 user nova-compute[87365]:       <nova:owner>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 14:09:39 user nova-compute[87365]:       </nova:owner>
Nov 08 14:09:39 user nova-compute[87365]:       <nova:ports>
Nov 08 14:09:39 user nova-compute[87365]:         <nova:port uuid="d7bd50e3-09b6-4bb1-876c-28bbc5caa016">
Nov 08 14:09:39 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 14:09:39 user nova-compute[87365]:         </nova:port>
Nov 08 14:09:39 user nova-compute[87365]:       </nova:ports>
Nov 08 14:09:39 user nova-compute[87365]:     </nova:instance>
Nov 08 14:09:39 user nova-compute[87365]:   </metadata>
Nov 08 14:09:39 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:09:39 user nova-compute[87365]:     <system>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="serial">e437c171-4346-498a-abbb-030e7c952d91</entry>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="uuid">e437c171-4346-498a-abbb-030e7c952d91</entry>
Nov 08 14:09:39 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:09:39 user nova-compute[87365]:     </system>
Nov 08 14:09:39 user nova-compute[87365]:   </sysinfo>
Nov 08 14:09:39 user nova-compute[87365]:   <os>
Nov 08 14:09:39 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:09:39 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:09:39 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:09:39 user nova-compute[87365]:   </os>
Nov 08 14:09:39 user nova-compute[87365]:   <features>
Nov 08 14:09:39 user nova-compute[87365]:     <acpi/>
Nov 08 14:09:39 user nova-compute[87365]:     <apic/>
Nov 08 14:09:39 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:09:39 user nova-compute[87365]:   </features>
Nov 08 14:09:39 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:09:39 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:09:39 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:09:39 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:09:39 user nova-compute[87365]:   </clock>
Nov 08 14:09:39 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:09:39 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:09:39 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:09:39 user nova-compute[87365]:   </cpu>
Nov 08 14:09:39 user nova-compute[87365]:   <devices>
Nov 08 14:09:39 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:09:39 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:09:39 user nova-compute[87365]:       <source dev="/dev/sde"/>
Nov 08 14:09:39 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:09:39 user nova-compute[87365]:       <serial>d90fff52-7c64-4e39-9bf3-2c77bef47d64</serial>
Nov 08 14:09:39 user nova-compute[87365]:     </disk>
Nov 08 14:09:39 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:09:39 user nova-compute[87365]:       <mac address="fa:16:3e:ad:34:80"/>
Nov 08 14:09:39 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:09:39 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:09:39 user nova-compute[87365]:       <target dev="tapd7bd50e3-09"/>
Nov 08 14:09:39 user nova-compute[87365]:     </interface>
Nov 08 14:09:39 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:09:39 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/e437c171-4346-498a-abbb-030e7c952d91/console.log" append="off"/>
Nov 08 14:09:39 user nova-compute[87365]:     </serial>
Nov 08 14:09:39 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:09:39 user nova-compute[87365]:     <video>
Nov 08 14:09:39 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:09:39 user nova-compute[87365]:     </video>
Nov 08 14:09:39 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:09:39 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:09:39 user nova-compute[87365]:     </rng>
Nov 08 14:09:39 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:09:39 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:09:39 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:09:39 user nova-compute[87365]:     </memballoon>
Nov 08 14:09:39 user nova-compute[87365]:   </devices>
Nov 08 14:09:39 user nova-compute[87365]: </domain>
Nov 08 14:09:39 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141171971',display_name='tempest-TestVolumeBootPattern-server-141171971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141171971',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-g734x75f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:09:11Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=e437c171-4346-498a-abbb-030e7c952d91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG os_vif [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0c185d1-39c8-5ff6-bc3a-e6ffe5a82244', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7bd50e3-09, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7bd50e3-09, col_values=(('qos', UUID('fb7766c6-56b5-4ad5-a8c8-03cb84e00257')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7bd50e3-09, col_values=(('external_ids', {'iface-id': 'd7bd50e3-09b6-4bb1-876c-28bbc5caa016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:34:80', 'vm-uuid': 'e437c171-4346-498a-abbb-030e7c952d91'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: INFO os_vif [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09')
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:ad:34:80, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] No waiting events found dispatching network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:09:39 user nova-compute[87365]: WARNING nova.compute.manager [req-5e79ba64-e1f2-4667-b93e-34509b6da47e req-59765d85-6b0c-4475-b59c-afc58384571b service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received unexpected event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 for instance with vm_state building and task_state spawning.
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] No waiting events found dispatching network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:09:41 user nova-compute[87365]: WARNING nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received unexpected event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 for instance with vm_state building and task_state spawning.
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] No waiting events found dispatching network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:09:41 user nova-compute[87365]: WARNING nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received unexpected event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 for instance with vm_state building and task_state spawning.
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] No waiting events found dispatching network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:09:41 user nova-compute[87365]: WARNING nova.compute.manager [req-722e79a6-fe20-44a3-b2a5-b38bc1e0be6d req-bb344c62-c315-4b71-9833-9b39fe925367 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received unexpected event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 for instance with vm_state building and task_state spawning.
Nov 08 14:09:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:09:42 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Instance spawned successfully.
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:42 user nova-compute[87365]: INFO nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Took 7.28 seconds to spawn the instance on the hypervisor.
Nov 08 14:09:42 user nova-compute[87365]: DEBUG nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:09:43 user nova-compute[87365]: INFO nova.compute.manager [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Took 8.14 seconds to build instance.
Nov 08 14:09:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-64ec3e81-0fb2-48bc-9817-a51584574935 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.283s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:09:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] Instance spawned successfully.
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:09:43 user nova-compute[87365]: INFO nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 08 14:09:43 user nova-compute[87365]: DEBUG nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:09:43 user nova-compute[87365]: INFO nova.compute.manager [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Took 33.90 seconds to build instance.
Nov 08 14:09:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-aaa7ecb6-7afa-429d-98a4-792aa679bbef tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.012s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:09:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:09:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:09:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:09:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=24.340003967285156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:09:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:09:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 1f33375d-af45-4ce6-b51d-18cbcf50b723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e437c171-4346-498a-abbb-030e7c952d91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:09:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:09:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:09:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:09:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:09:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:09:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:09:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:09:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:09:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 2 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:09:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deletion of /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize failed
Nov 08 14:09:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:09:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:10:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:10:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'info_cache' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:17 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:10:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance destroyed successfully.
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'resources' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37bcfa01-a2, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec4693be-b298-4db5-a373-7d689044a778) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:18 user nova-compute[87365]: INFO os_vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:10:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847c33b-7fea-490f-82cf-9f01b993a045]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:10:18 user nova-compute[87365]: No targets found.
Nov 08 14:10:18 user nova-compute[87365]: iSNS:
Nov 08 14:10:18 user nova-compute[87365]: No targets found.
Nov 08 14:10:18 user nova-compute[87365]: STATIC:
Nov 08 14:10:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389
Nov 08 14:10:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:10:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:10:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:10:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:10:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:10:18 user nova-compute[87365]: FIRMWARE:
Nov 08 14:10:18 user nova-compute[87365]: No targets found.
Nov 08 14:10:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:10:18 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:10:18 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060d4e5-b57e-48df-90d1-5e0ee0e0b40a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c32a4d-ef21-4979-b774-beed9f5d80d4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:18 user nova-compute[87365]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:18 user nova-compute[87365]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4cb2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c830ddf-9d2b-457d-a1f3-10af5204e3bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b8a95-4f73-4dfc-90d1-0842ff38bc86]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafac4b3-48f5-4376-b687-9c17a65b5f59]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6b8e88-02f5-4ebc-bbd4-da5adbdbc237]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[626758d0-3b90-43bd-bdf0-79759a10a1f6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e131c593-833a-4738-9596-96a63260bc4b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]
Nov 08 14:10:18 user nova-compute[87365]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.
Nov 08 14:10:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb125c-bfb4-4f0f-962f-a599f18fd2aa]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== disconnect_volume: return (309ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start _get_guest_xml network_info=[{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '937e7773-8812-406a-87f3-48373678eeb1', 'attached_at': '', 'detached_at': '', 'volume_id': '691a6d7e-03af-47cf-b7a8-16414ed7f389', 'serial': '691a6d7e-03af-47cf-b7a8-16414ed7f389'}, 'attachment_id': 'd32ecaa8-3ef8-4e56-a861-02cbb53e02c9', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'numa_topology' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:10:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:10:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:10:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:10:18 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e706f9c-31e0-4720-a0a7-4342868c4439]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:10:18 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc67bc6-1bf3-4a1b-8e85-7f1b02203ffd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389] added
Nov 08 14:10:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a5a29-0930-4696-87ff-cb787b36c3b0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[708aba5d-ebef-4638-b8d5-eaf12fcb7a89]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjDKqTOG {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjDKqTOG" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0e24c-0703-4412-bc8d-6fc634825876]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tjDKqTOG'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ca20d-f212-4358-8406-1e3649daa727]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79466676-e6d4-4870-84fc-1bac96adbaeb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d5edb-13bb-4019-97ec-03b9c22c1d61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]
Nov 08 14:10:19 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.
Nov 08 14:10:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4611f-d198-4d6b-be5f-b83a82c96cd1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d830b0-81fe-4173-bafa-8f45ccebf0e8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9ac9fa-2b5c-4710-8835-8fcb33d158f8]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26431303135316233', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431303135316233', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'pci_devices' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:10:20 user nova-compute[87365]:   <uuid>937e7773-8812-406a-87f3-48373678eeb1</uuid>
Nov 08 14:10:20 user nova-compute[87365]:   <name>instance-00000028</name>
Nov 08 14:10:20 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:10:20 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:10:20 user nova-compute[87365]:   <metadata>
Nov 08 14:10:20 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:10:20 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeTestJSON-server-1435204684</nova:name>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:10:18</nova:creationTime>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:10:20 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:10:20 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:owner>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:user uuid="c8951eb125524b84a913e2e66e857fbc">tempest-AttachVolumeTestJSON-1235364264-project-member</nova:user>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:project uuid="2c632e7ef13f4b03b843ce2996ecd29f">tempest-AttachVolumeTestJSON-1235364264</nova:project>
Nov 08 14:10:20 user nova-compute[87365]:       </nova:owner>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:10:20 user nova-compute[87365]:       <nova:ports>
Nov 08 14:10:20 user nova-compute[87365]:         <nova:port uuid="37bcfa01-a258-4259-8c18-44119de8d394">
Nov 08 14:10:20 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:10:20 user nova-compute[87365]:         </nova:port>
Nov 08 14:10:20 user nova-compute[87365]:       </nova:ports>
Nov 08 14:10:20 user nova-compute[87365]:     </nova:instance>
Nov 08 14:10:20 user nova-compute[87365]:   </metadata>
Nov 08 14:10:20 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:10:20 user nova-compute[87365]:     <system>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="serial">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="uuid">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:10:20 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:10:20 user nova-compute[87365]:     </system>
Nov 08 14:10:20 user nova-compute[87365]:   </sysinfo>
Nov 08 14:10:20 user nova-compute[87365]:   <os>
Nov 08 14:10:20 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:10:20 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:10:20 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:10:20 user nova-compute[87365]:   </os>
Nov 08 14:10:20 user nova-compute[87365]:   <features>
Nov 08 14:10:20 user nova-compute[87365]:     <acpi/>
Nov 08 14:10:20 user nova-compute[87365]:     <apic/>
Nov 08 14:10:20 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:10:20 user nova-compute[87365]:   </features>
Nov 08 14:10:20 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:10:20 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:10:20 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:10:20 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:10:20 user nova-compute[87365]:   </clock>
Nov 08 14:10:20 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:10:20 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:10:20 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:10:20 user nova-compute[87365]:   </cpu>
Nov 08 14:10:20 user nova-compute[87365]:   <devices>
Nov 08 14:10:20 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:10:20 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:10:20 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk"/>
Nov 08 14:10:20 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:10:20 user nova-compute[87365]:     </disk>
Nov 08 14:10:20 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:10:20 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:10:20 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 14:10:20 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 14:10:20 user nova-compute[87365]:       <serial>691a6d7e-03af-47cf-b7a8-16414ed7f389</serial>
Nov 08 14:10:20 user nova-compute[87365]:     </disk>
Nov 08 14:10:20 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:10:20 user nova-compute[87365]:       <mac address="fa:16:3e:65:e2:8a"/>
Nov 08 14:10:20 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:10:20 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:10:20 user nova-compute[87365]:       <target dev="tap37bcfa01-a2"/>
Nov 08 14:10:20 user nova-compute[87365]:     </interface>
Nov 08 14:10:20 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:10:20 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/console.log" append="off"/>
Nov 08 14:10:20 user nova-compute[87365]:     </serial>
Nov 08 14:10:20 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:10:20 user nova-compute[87365]:     <video>
Nov 08 14:10:20 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:10:20 user nova-compute[87365]:     </video>
Nov 08 14:10:20 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:10:20 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:10:20 user nova-compute[87365]:     </rng>
Nov 08 14:10:20 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:10:20 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:10:20 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:10:20 user nova-compute[87365]:     </memballoon>
Nov 08 14:10:20 user nova-compute[87365]:   </devices>
Nov 08 14:10:20 user nova-compute[87365]: </domain>
Nov 08 14:10:20 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-changed-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.compute.manager [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Refreshing instance network info cache due to event network-changed-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] Acquiring lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] Acquired lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.network.neutron [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Refreshing network info cache for port 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:10:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Cannot resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'migration_context' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.objects.base [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG os_vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a3d642f-e5cb-56bc-8929-a20462c4051d', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37bcfa01-a2, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37bcfa01-a2, col_values=(('qos', UUID('e3753064-c6da-4d0e-9391-177025c5aed7')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37bcfa01-a2, col_values=(('external_ids', {'iface-id': '37bcfa01-a258-4259-8c18-44119de8d394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:e2:8a', 'vm-uuid': '937e7773-8812-406a-87f3-48373678eeb1'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:21 user nova-compute[87365]: INFO os_vif [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updated VIF entry in instance network info cache for port 9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG nova.network.neutron [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating instance_info_cache with network_info: [{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:10:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c27e8c4a-15cf-430f-8264-514e87718428 req-913a232e-aab9-4eb2-a482-dd21844bc121 service nova] Releasing lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:10:22 user nova-compute[87365]: WARNING nova.compute.manager [req-f4f91102-0776-4dc8-a8fc-0f2eb88319ca req-7feba697-858e-43da-8c1d-6762de967d1f service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state stopped and task_state powering-on.
Nov 08 14:10:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:10:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance rebooted successfully.
Nov 08 14:10:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4a37d6ba-37bc-4d67-aab3-09a13ba306c9 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:24 user nova-compute[87365]: INFO nova.compute.manager [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Terminating instance
Nov 08 14:10:24 user nova-compute[87365]: DEBUG nova.compute.manager [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:10:24 user nova-compute[87365]: WARNING nova.compute.manager [req-0105becd-684f-4deb-9b04-12b477b675d2 req-6020a998-c808-4b53-8eaf-4dd128159f31 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state active and task_state None.
Nov 08 14:10:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Instance destroyed successfully.
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.objects.instance [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lazy-loading 'resources' on Instance uuid 1f33375d-af45-4ce6-b51d-18cbcf50b723 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1824025760',display_name='tempest-SnapshotDataIntegrityTests-server-1824025760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1824025760',id=31,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy3EZdlsswVCDE1CgwBq1mJ8h/XumcylYuC/rvOCjCBekultcRhnnCgJ+JcHoQmBK5Pgop1nUjxnGM3tOy6RJ38ndo64ww9D+xAnqxesj8WVIx/WeZjglUtZiHSp3NUrg==',key_name='tempest-keypair-1613074681',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed3009d663c40e993a1686fc0b7610a',ramdisk_id='',reservation_id='r-szo0jegy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2082748282',owner_user_name='tempest-SnapshotDataIntegrityTests-2082748282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='655ec7640dd941a694935dce487dc084',uuid=1f33375d-af45-4ce6-b51d-18cbcf50b723,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converting VIF {"id": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "address": "fa:16:3e:65:d0:12", "network": {"id": "be64f70a-8076-461a-bb7c-71698ed6d327", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2054064249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed3009d663c40e993a1686fc0b7610a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc605ea5c-72", "ovs_interfaceid": "c605ea5c-72cf-4291-9ffb-eaeb0c449506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG os_vif [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc605ea5c-72, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16fe0424-ca2f-4bf0-afc3-e63998420f18) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:10:25 user nova-compute[87365]: INFO os_vif [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:12,bridge_name='br-int',has_traffic_filtering=True,id=c605ea5c-72cf-4291-9ffb-eaeb0c449506,network=Network(be64f70a-8076-461a-bb7c-71698ed6d327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc605ea5c-72')
Nov 08 14:10:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Deleting instance files /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723_del
Nov 08 14:10:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Deletion of /opt/stack/data/nova/instances/1f33375d-af45-4ce6-b51d-18cbcf50b723_del complete
Nov 08 14:10:25 user nova-compute[87365]: INFO nova.compute.manager [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 14:10:25 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:10:25 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-unplugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] No waiting events found dispatching network-vif-unplugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-unplugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Acquiring lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] No waiting events found dispatching network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:10:26 user nova-compute[87365]: WARNING nova.compute.manager [req-639ab142-6c84-463b-96dc-a61136291c83 req-69b1d585-33f5-422b-9d24-823cbf3f50a2 service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received unexpected event network-vif-plugged-c605ea5c-72cf-4291-9ffb-eaeb0c449506 for instance with vm_state active and task_state deleting.
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:26 user nova-compute[87365]: INFO nova.compute.manager [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Attaching volume a8060cd2-6d78-42f1-9816-f61631116af5 to /dev/vdb
Nov 08 14:10:26 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:10:26 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Took 1.29 seconds to deallocate network for instance.
Nov 08 14:10:26 user nova-compute[87365]: DEBUG os_brick.utils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:10:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a082f-6119-44cf-b478-fb8f3da20f78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdb2e1-caed-4e32-966f-207e23038e2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d71f35-b584-4032-957b-44ef3041b16b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09089a-c7f4-45d1-bdcb-fc4dadbe3b51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:10:27 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ee745-6e00-4908-bed1-1bbe8983a031]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG os_brick.utils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating existing volume attachment record: 3492e6b9-3648-47e5-baac-3ebabe831da0 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:27 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Deleted allocations for instance 1f33375d-af45-4ce6-b51d-18cbcf50b723
Nov 08 14:10:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-559d3bc7-64b6-4295-82ef-f10a1d9b9138 tempest-SnapshotDataIntegrityTests-2082748282 tempest-SnapshotDataIntegrityTests-2082748282-project-member] Lock "1f33375d-af45-4ce6-b51d-18cbcf50b723" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.162s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-29cfed65-78d5-4398-ab37-92a877d3b569 req-c65a85b7-caa2-4d26-a330-1166f97bd3ae service nova] [instance: 1f33375d-af45-4ce6-b51d-18cbcf50b723] Received event network-vif-deleted-c605ea5c-72cf-4291-9ffb-eaeb0c449506 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:44 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:10:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:10:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=24.32907485961914GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance e437c171-4346-498a-abbb-030e7c952d91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNGfKuWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:10:50 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:10:50 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:10:50 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:10:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e25cdcd-952c-4051-9d63-d01f1a2b9d11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:10:50 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9595e4-3412-457e-9807-ce0491d30a3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5] added
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9a1760-e9e9-4d10-84c4-5fb02e5c66c1]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab88cde-75fc-4a48-ac1b-d527ce9a6fc7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNGfKuWv {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNGfKuWv" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[149119fc-160b-4450-8df6-eca26e841c7b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pNGfKuWv'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[713da3e3-6552-48ef-894c-706e36ea55c5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f11764a-e769-44c2-884a-3f992c08c3f1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0a329-be7c-4878-8876-1ca93682c3b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260]
Nov 08 14:10:51 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260] successful.
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f3ee6d-79b7-4874-88b9-7564e00aca80]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4059666-70f4-41f0-991d-adab5966423c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:10:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a1f460-3ff0-4824-aad3-060fed9a6cca]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:10:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNGfKuWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23437616263633634', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437616263633634', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:10:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:10:52 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:10:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:10:52 user nova-compute[87365]:   <serial>a8060cd2-6d78-42f1-9816-f61631116af5</serial>
Nov 08 14:10:52 user nova-compute[87365]: </disk>
Nov 08 14:10:52 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:39:47:c2, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:10:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5fcc5751-8f0f-4f05-88f4-75230e84733e tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.011s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid e437c171-4346-498a-abbb-030e7c952d91 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "e437c171-4346-498a-abbb-030e7c952d91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "e437c171-4346-498a-abbb-030e7c952d91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:10:56 user nova-compute[87365]: INFO nova.compute.claims [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Claim successful on node user
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:10:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG nova.policy [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33521b67405a405f912d0879b3d77829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a890ce53c34008a7a872f409fe4550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:10:56 user nova-compute[87365]: INFO nova.virt.block_device [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Booting with volume 03d67d33-8bac-450a-a31e-515552b0351e at /dev/vda
Nov 08 14:10:56 user nova-compute[87365]: DEBUG os_brick.utils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c71b8-3e9f-4113-a4f9-093f96572340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[530efba8-fc29-4881-98ba-de6daa246fa3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.075s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c59a89-6035-4b44-986b-a737bedbf4a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457d396-bd18-402e-9394-f1c0cc605112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:10:57 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08b64b3-f6a2-4a28-87bb-78ef327aad7b]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG os_brick.utils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating existing volume attachment record: dfa90028-0bf4-4b2d-b128-76d64aed95b1 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Successfully created port: c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:57 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:10:57 user nova-compute[87365]: INFO nova.compute.claims [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Claim successful on node user
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:10:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:10:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Creating image(s)
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "/opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.policy [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f500e55fac46c59f38b0cd17172299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58ecaf473940859738817c8a91b64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Successfully updated port: c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-changed-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Refreshing instance network info cache due to event network-changed-c3645578-72ef-4aad-905a-f1dbb769299d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.228s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk 1073741824" returned: 0 in 0.061s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance network_info: |[{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Refreshing network info cache for port c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Cannot resize image /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Ensure instance console log exists: /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:10:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Successfully created port: 09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updated VIF entry in instance network info cache for port c3645578-72ef-4aad-905a-f1dbb769299d. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3fb268f3-5f12-4de1-8ce4-fe3988f0e5ab req-80ae275b-19f4-4403-adcb-03218ba5e35e service nova] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Successfully updated port: 09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquired lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-changed-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Refreshing instance network info cache due to event network-changed-09286f0e-4961-4500-90f6-c6ba6470aeb5. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] Acquiring lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updating instance_info_cache with network_info: [{"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Releasing lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Instance network_info: |[{"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] Acquired lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Refreshing network info cache for port 09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Start _get_guest_xml network_info=[{"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:11:00 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:00 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1368960089',display_name='tempest-AttachVolumeNegativeTest-server-1368960089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1368960089',id=45,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHXHEQyODs15xakoAqw0Z7R0WCXGbG8jfRgXfWTkW5rMgjjTIPiH9kfQeFp5KZeIGzOrQIu84rtES1kJi/hwNQ6UhXHHjOX8gn80rXpbte3tPAK6Rn61aSmsdofftCJuQ==',key_name='tempest-keypair-1509162836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-7ycsgnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=a292ae64-23d2-4c99-9cc7-562656a06ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:11:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'pci_devices' on Instance uuid a292ae64-23d2-4c99-9cc7-562656a06ead {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:11:01 user nova-compute[87365]:   <uuid>a292ae64-23d2-4c99-9cc7-562656a06ead</uuid>
Nov 08 14:11:01 user nova-compute[87365]:   <name>instance-0000002d</name>
Nov 08 14:11:01 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:11:01 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:11:01 user nova-compute[87365]:   <metadata>
Nov 08 14:11:01 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:11:01 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1368960089</nova:name>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:11:00</nova:creationTime>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:11:01 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:11:01 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:owner>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:user uuid="25f500e55fac46c59f38b0cd17172299">tempest-AttachVolumeNegativeTest-1316129282-project-member</nova:user>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:project uuid="3e58ecaf473940859738817c8a91b64c">tempest-AttachVolumeNegativeTest-1316129282</nova:project>
Nov 08 14:11:01 user nova-compute[87365]:       </nova:owner>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:11:01 user nova-compute[87365]:       <nova:ports>
Nov 08 14:11:01 user nova-compute[87365]:         <nova:port uuid="09286f0e-4961-4500-90f6-c6ba6470aeb5">
Nov 08 14:11:01 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 14:11:01 user nova-compute[87365]:         </nova:port>
Nov 08 14:11:01 user nova-compute[87365]:       </nova:ports>
Nov 08 14:11:01 user nova-compute[87365]:     </nova:instance>
Nov 08 14:11:01 user nova-compute[87365]:   </metadata>
Nov 08 14:11:01 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:11:01 user nova-compute[87365]:     <system>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="serial">a292ae64-23d2-4c99-9cc7-562656a06ead</entry>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="uuid">a292ae64-23d2-4c99-9cc7-562656a06ead</entry>
Nov 08 14:11:01 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:11:01 user nova-compute[87365]:     </system>
Nov 08 14:11:01 user nova-compute[87365]:   </sysinfo>
Nov 08 14:11:01 user nova-compute[87365]:   <os>
Nov 08 14:11:01 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:11:01 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:11:01 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:11:01 user nova-compute[87365]:   </os>
Nov 08 14:11:01 user nova-compute[87365]:   <features>
Nov 08 14:11:01 user nova-compute[87365]:     <acpi/>
Nov 08 14:11:01 user nova-compute[87365]:     <apic/>
Nov 08 14:11:01 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:11:01 user nova-compute[87365]:   </features>
Nov 08 14:11:01 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:11:01 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:11:01 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:11:01 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:11:01 user nova-compute[87365]:   </clock>
Nov 08 14:11:01 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:11:01 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:11:01 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:11:01 user nova-compute[87365]:   </cpu>
Nov 08 14:11:01 user nova-compute[87365]:   <devices>
Nov 08 14:11:01 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:11:01 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:11:01 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk"/>
Nov 08 14:11:01 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:11:01 user nova-compute[87365]:     </disk>
Nov 08 14:11:01 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:11:01 user nova-compute[87365]:       <mac address="fa:16:3e:c5:db:89"/>
Nov 08 14:11:01 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:11:01 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:11:01 user nova-compute[87365]:       <target dev="tap09286f0e-49"/>
Nov 08 14:11:01 user nova-compute[87365]:     </interface>
Nov 08 14:11:01 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:11:01 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/console.log" append="off"/>
Nov 08 14:11:01 user nova-compute[87365]:     </serial>
Nov 08 14:11:01 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:11:01 user nova-compute[87365]:     <video>
Nov 08 14:11:01 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:11:01 user nova-compute[87365]:     </video>
Nov 08 14:11:01 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:11:01 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:11:01 user nova-compute[87365]:     </rng>
Nov 08 14:11:01 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:11:01 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:11:01 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:11:01 user nova-compute[87365]:     </memballoon>
Nov 08 14:11:01 user nova-compute[87365]:   </devices>
Nov 08 14:11:01 user nova-compute[87365]: </domain>
Nov 08 14:11:01 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1368960089',display_name='tempest-AttachVolumeNegativeTest-server-1368960089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1368960089',id=45,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHXHEQyODs15xakoAqw0Z7R0WCXGbG8jfRgXfWTkW5rMgjjTIPiH9kfQeFp5KZeIGzOrQIu84rtES1kJi/hwNQ6UhXHHjOX8gn80rXpbte3tPAK6Rn61aSmsdofftCJuQ==',key_name='tempest-keypair-1509162836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-7ycsgnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=a292ae64-23d2-4c99-9cc7-562656a06ead,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG os_vif [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84d505ec-e4f8-5dc6-8a7e-1310695e66c4', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09286f0e-49, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09286f0e-49, col_values=(('qos', UUID('698fd01d-b442-4080-b36a-679efb82e295')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09286f0e-49, col_values=(('external_ids', {'iface-id': '09286f0e-4961-4500-90f6-c6ba6470aeb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:db:89', 'vm-uuid': 'a292ae64-23d2-4c99-9cc7-562656a06ead'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:01 user nova-compute[87365]: INFO os_vif [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49')
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:c5:db:89, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updated VIF entry in instance network info cache for port 09286f0e-4961-4500-90f6-c6ba6470aeb5. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG nova.network.neutron [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updating instance_info_cache with network_info: [{"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c9052d23-b89a-44dc-97fe-dce435c827f4 req-498b4316-c044-45cc-92da-b488b3e97028 service nova] Releasing lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-changed-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Refreshing instance network info cache due to event network-changed-d7bd50e3-09b6-4bb1-876c-28bbc5caa016. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] Acquiring lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] Acquired lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Refreshing network info cache for port d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updated VIF entry in instance network info cache for port d7bd50e3-09b6-4bb1-876c-28bbc5caa016. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.network.neutron [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updating instance_info_cache with network_info: [{"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ca439d55-cea6-43eb-ac62-2ca363e72309 req-723ea221-2393-43df-89f9-d72400e45b76 service nova] Releasing lock "refresh_cache-e437c171-4346-498a-abbb-030e7c952d91" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:02 user nova-compute[87365]: INFO nova.compute.manager [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Terminating instance
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:02 user nova-compute[87365]: DEBUG nova.compute.manager [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] No waiting events found dispatching network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:02 user nova-compute[87365]: WARNING nova.compute.manager [req-7c56e8f9-a654-4616-97bf-be8ca82b34ee req-e324f00d-63f4-4a90-ad58-a44e51a9ce4d service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received unexpected event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 for instance with vm_state building and task_state spawning.
Nov 08 14:11:03 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] Instance destroyed successfully.
Nov 08 14:11:03 user nova-compute[87365]: DEBUG nova.objects.instance [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid e437c171-4346-498a-abbb-030e7c952d91 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141171971',display_name='tempest-TestVolumeBootPattern-server-141171971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141171971',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-g734x75f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:09:44Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=e437c171-4346-498a-abbb-030e7c952d91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "address": "fa:16:3e:ad:34:80", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bd50e3-09", "ovs_interfaceid": "d7bd50e3-09b6-4bb1-876c-28bbc5caa016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_vif [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7bd50e3-09, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb7766c6-56b5-4ad5-a8c8-03cb84e00257) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:03 user nova-compute[87365]: INFO os_vif [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:80,bridge_name='br-int',has_traffic_filtering=True,id=d7bd50e3-09b6-4bb1-876c-28bbc5caa016,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bd50e3-09')
Nov 08 14:11:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:03 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[757b2a72-589d-4ea9-bc6c-917b32a9a342]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:11:03 user nova-compute[87365]: No targets found.
Nov 08 14:11:03 user nova-compute[87365]: iSNS:
Nov 08 14:11:03 user nova-compute[87365]: No targets found.
Nov 08 14:11:03 user nova-compute[87365]: STATIC:
Nov 08 14:11:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:11:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:11:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:11:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389
Nov 08 14:11:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:11:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:11:03 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:11:03 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:11:03 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:11:03 user nova-compute[87365]: FIRMWARE:
Nov 08 14:11:03 user nova-compute[87365]: No targets found.
Nov 08 14:11:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:11:03 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:11:03 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b425f-a2d1-493a-b715-71c95e95200d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[93560e0e-0959-44c7-8e55-83e3ebbf9e67]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d182d5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.103s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5bfbbd-740c-4581-999f-40ace4d53ae6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67f152-070c-452b-b5dd-df4f2069bb01]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f302b-e7be-471d-9dec-0dd7cf000478]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.098s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47c941-920f-4a45-9736-d11dff1c5ace]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23336663033333263', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b4f85cee', '/dev/disk/by-id/scsi-1SCST_BIOb4f85cee-36f0332c8f90f43e') {{(pid=99274) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76b019-f673-46bc-8f4e-14c810226cd4]: (4, None) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832c13d-dee5-4532-9423-6df21aac55af]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a56286-4406-4c24-a723-9e37fc6532f2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]
Nov 08 14:11:03 user nova-compute[87365]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.
Nov 08 14:11:03 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[61049b31-2747-48d8-b75b-cf33aace22c2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (523ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:11:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Deleting instance files /opt/stack/data/nova/instances/e437c171-4346-498a-abbb-030e7c952d91_del
Nov 08 14:11:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Deletion of /opt/stack/data/nova/instances/e437c171-4346-498a-abbb-030e7c952d91_del complete
Nov 08 14:11:04 user nova-compute[87365]: INFO nova.compute.manager [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-unplugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] No waiting events found dispatching network-vif-unplugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-unplugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Acquiring lock "e437c171-4346-498a-abbb-030e7c952d91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] Lock "e437c171-4346-498a-abbb-030e7c952d91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] No waiting events found dispatching network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:04 user nova-compute[87365]: WARNING nova.compute.manager [req-a6a339c8-99f5-45e2-a254-9deb9a5d3c7d req-edf8b02c-ee0a-40f8-bc31-38663fd25d26 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received unexpected event network-vif-plugged-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 for instance with vm_state active and task_state deleting.
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] No waiting events found dispatching network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:04 user nova-compute[87365]: WARNING nova.compute.manager [req-c6620fa9-b5d7-41f5-abb6-29faea143ae9 req-d5b3b739-5b07-4a5c-a5ab-3a85ec619944 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received unexpected event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 for instance with vm_state building and task_state spawning.
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:11:04 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:11:04 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Instance spawned successfully.
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:05 user nova-compute[87365]: INFO nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:05 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: e437c171-4346-498a-abbb-030e7c952d91] Took 1.05 seconds to deallocate network for instance.
Nov 08 14:11:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-56d5ee63-a1fe-424d-a2ae-0fe7a79b7733 req-89cb28f6-a8e1-42dc-8e1d-1590be423086 service nova] [instance: e437c171-4346-498a-abbb-030e7c952d91] Received event network-vif-deleted-d7bd50e3-09b6-4bb1-876c-28bbc5caa016 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:05 user nova-compute[87365]: INFO nova.compute.manager [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Took 7.35 seconds to build instance.
Nov 08 14:11:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b04411f4-0ecb-4d07-a84e-1d74d1847f83 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.829s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:06 user nova-compute[87365]: INFO nova.compute.manager [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: e437c171-4346-498a-abbb-030e7c952d91] Took 1.07 seconds to detach 1 volumes for instance.
Nov 08 14:11:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:11:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:11:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:06 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance e437c171-4346-498a-abbb-030e7c952d91
Nov 08 14:11:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-c04bb0fa-951a-47b3-a7cd-afe2838d3d73 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "e437c171-4346-498a-abbb-030e7c952d91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.040s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:11:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:11:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Creating image(s)
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Ensure instance console log exists: /opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start _get_guest_xml network_info=[{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2dec940-66be-4a6e-a3cb-3782788b3d36', 'attached_at': '', 'detached_at': '', 'volume_id': '03d67d33-8bac-450a-a31e-515552b0351e', 'serial': '03d67d33-8bac-450a-a31e-515552b0351e'}, 'attachment_id': 'dfa90028-0bf4-4b2d-b128-76d64aed95b1', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:11:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:11:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:11:21 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bea656-1f0f-47f6-91ce-3b200bb8c2bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:11:21 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3f621-228c-4b91-8ae3-26cfd8f93e89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e] added
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b59e4-86a3-4707-bdac-5d7659e9e05c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21bc1f5-74bb-4c24-a37b-5105b8909320]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHWNyusb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHWNyusb" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4061cce-2e0b-4906-a36d-4ba38fa54ce8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHWNyusb'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8f980-f2c9-4470-9619-bda32cf8b5d2]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c8c81-bbd6-4a1c-a352-f5fc04aa9bd4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc1bbe-2126-4cc7-a26c-a1455d38ab9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]
Nov 08 14:11:21 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74029f-2121-4907-8229-b29feb5b155c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cac7e7-c37c-4290-8d36-b646f66552ab]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d53748-b9f4-427e-be82-b33ffbfed506]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23737306164363065', 'path': '/dev/sdd'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737306164363065', 'path': '/dev/sdd'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'pci_devices' on Instance uuid d2dec940-66be-4a6e-a3cb-3782788b3d36 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:11:22 user nova-compute[87365]:   <uuid>d2dec940-66be-4a6e-a3cb-3782788b3d36</uuid>
Nov 08 14:11:22 user nova-compute[87365]:   <name>instance-0000002c</name>
Nov 08 14:11:22 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:11:22 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:11:22 user nova-compute[87365]:   <metadata>
Nov 08 14:11:22 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:11:22 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:11:22 user nova-compute[87365]:       <nova:name>tempest-ServerActionsTestOtherA-server-721364548</nova:name>
Nov 08 14:11:22 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:11:21</nova:creationTime>
Nov 08 14:11:22 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:11:22 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:11:22 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:11:22 user nova-compute[87365]:       <nova:owner>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:user uuid="33521b67405a405f912d0879b3d77829">tempest-ServerActionsTestOtherA-777028083-project-member</nova:user>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:project uuid="90a890ce53c34008a7a872f409fe4550">tempest-ServerActionsTestOtherA-777028083</nova:project>
Nov 08 14:11:22 user nova-compute[87365]:       </nova:owner>
Nov 08 14:11:22 user nova-compute[87365]:       <nova:ports>
Nov 08 14:11:22 user nova-compute[87365]:         <nova:port uuid="c3645578-72ef-4aad-905a-f1dbb769299d">
Nov 08 14:11:22 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 14:11:22 user nova-compute[87365]:         </nova:port>
Nov 08 14:11:22 user nova-compute[87365]:       </nova:ports>
Nov 08 14:11:22 user nova-compute[87365]:     </nova:instance>
Nov 08 14:11:22 user nova-compute[87365]:   </metadata>
Nov 08 14:11:22 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:11:22 user nova-compute[87365]:     <system>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="serial">d2dec940-66be-4a6e-a3cb-3782788b3d36</entry>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="uuid">d2dec940-66be-4a6e-a3cb-3782788b3d36</entry>
Nov 08 14:11:22 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:11:22 user nova-compute[87365]:     </system>
Nov 08 14:11:22 user nova-compute[87365]:   </sysinfo>
Nov 08 14:11:22 user nova-compute[87365]:   <os>
Nov 08 14:11:22 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:11:22 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:11:22 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:11:22 user nova-compute[87365]:   </os>
Nov 08 14:11:22 user nova-compute[87365]:   <features>
Nov 08 14:11:22 user nova-compute[87365]:     <acpi/>
Nov 08 14:11:22 user nova-compute[87365]:     <apic/>
Nov 08 14:11:22 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:11:22 user nova-compute[87365]:   </features>
Nov 08 14:11:22 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:11:22 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:11:22 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:11:22 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:11:22 user nova-compute[87365]:   </clock>
Nov 08 14:11:22 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:11:22 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:11:22 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:11:22 user nova-compute[87365]:   </cpu>
Nov 08 14:11:22 user nova-compute[87365]:   <devices>
Nov 08 14:11:22 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:11:22 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:11:22 user nova-compute[87365]:       <source dev="/dev/sdd"/>
Nov 08 14:11:22 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:11:22 user nova-compute[87365]:       <serial>03d67d33-8bac-450a-a31e-515552b0351e</serial>
Nov 08 14:11:22 user nova-compute[87365]:     </disk>
Nov 08 14:11:22 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:11:22 user nova-compute[87365]:       <mac address="fa:16:3e:b1:da:02"/>
Nov 08 14:11:22 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:11:22 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:11:22 user nova-compute[87365]:       <target dev="tapc3645578-72"/>
Nov 08 14:11:22 user nova-compute[87365]:     </interface>
Nov 08 14:11:22 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:11:22 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36/console.log" append="off"/>
Nov 08 14:11:22 user nova-compute[87365]:     </serial>
Nov 08 14:11:22 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:11:22 user nova-compute[87365]:     <video>
Nov 08 14:11:22 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:11:22 user nova-compute[87365]:     </video>
Nov 08 14:11:22 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:11:22 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:11:22 user nova-compute[87365]:     </rng>
Nov 08 14:11:22 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:11:22 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:11:22 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:11:22 user nova-compute[87365]:     </memballoon>
Nov 08 14:11:22 user nova-compute[87365]:   </devices>
Nov 08 14:11:22 user nova-compute[87365]: </domain>
Nov 08 14:11:22 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG os_vif [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '786f3d3d-e85e-5ff2-b9a2-0a18d23a632e', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3645578-72, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3645578-72, col_values=(('qos', UUID('fa563125-0878-42b1-b243-9845d184c393')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3645578-72, col_values=(('external_ids', {'iface-id': 'c3645578-72ef-4aad-905a-f1dbb769299d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:da:02', 'vm-uuid': 'd2dec940-66be-4a6e-a3cb-3782788b3d36'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:11:22 user nova-compute[87365]: INFO os_vif [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72')
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:11:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No VIF found with MAC fa:16:3e:b1:da:02, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:11:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:24 user nova-compute[87365]: WARNING nova.compute.manager [req-5c726a8b-9b93-4061-94cd-97b253c5eedb req-64e7247c-4436-4660-89c8-19c6a2299d21 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state building and task_state spawning.
Nov 08 14:11:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-changed-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Refreshing instance network info cache due to event network-changed-51d6cd01-6d74-4edb-8515-5c4fa186f861. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:11:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] Acquiring lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] Acquired lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Refreshing network info cache for port 51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:11:26 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance spawned successfully.
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.compute.manager [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:11:26 user nova-compute[87365]: WARNING nova.compute.manager [req-7d421eb9-a74e-49df-a31b-4023b4f84998 req-9ec91de8-188d-4fa9-98cd-79468da3013c service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state building and task_state spawning.
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:11:26 user nova-compute[87365]: INFO nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updated VIF entry in instance network info cache for port 51d6cd01-6d74-4edb-8515-5c4fa186f861. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.network.neutron [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating instance_info_cache with network_info: [{"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:26 user nova-compute[87365]: INFO nova.compute.manager [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Took 30.25 seconds to build instance.
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-269fa7d9-894a-4a27-8509-7aa9c359a70a req-6a9a22dc-4a4f-4821-96ad-9389eb24f888 service nova] Releasing lock "refresh_cache-0d1e3f3b-3789-44d0-853a-d8e886a536f7" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d09f212-6066-4238-af7f-0de08a23230a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.372s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG nova.objects.instance [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:26 user nova-compute[87365]: INFO nova.compute.manager [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attaching volume 22a09c4c-1d54-41db-9b7b-28618bc96e61 to /dev/vdb
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.utils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bbce1-d637-4a54-bb0d-9f50466ff695]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[668358f5-18bb-48cf-8f4f-0495d00d2a4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5c39a-fbb7-4f1d-9194-baacab730792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4d7c1-4091-44bb-a10e-ce124525f66b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:27 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:11:27 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[029595c7-08be-4c8a-99e8-8ff845299a97]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG os_brick.utils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating existing volume attachment record: a16313c6-22c3-4c69-a6b7-66b4a00038af {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:37 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:11:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:11:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:11:51 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:51 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8101MB free_disk=24.294147491455078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IACOcMWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:51 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:11:51 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:11:51 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[876117f6-78b5-4af1-9f08-f7daba49ffa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:11:51 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance a292ae64-23d2-4c99-9cc7-562656a06ead actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e034c-7342-450e-b6a9-9b1b88dd02db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61] added
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c70b3-b831-4719-a55f-4e8c9b9329e8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[434846e5-e687-433f-aeec-2cc15cab4b81]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IACOcMWp {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IACOcMWp" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[62524e6f-e37a-455e-9d1a-4d0f9bf427af]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IACOcMWp'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f6953-ec42-4001-9014-3c6fb3711e3b]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[50883643-56c1-449a-87b7-fe8fba3aa17c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dd2c9-e503-4828-8f89-d68205df3f0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260]
Nov 08 14:11:51 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260] successful.
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5fbc9-f2d2-4fa1-88ef-601a6f05edfc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ff6a4-8ba6-46fe-9c6a-3d87671cc23f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:11:51 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:11:51 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f053c9b-141b-423b-a389-3c1c27e64a78]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:11:51 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IACOcMWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26363316634353363', 'path': '/dev/sde'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363316634353363', 'path': '/dev/sde'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG nova.objects.instance [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:11:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:11:52 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:11:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:11:52 user nova-compute[87365]:   <serial>22a09c4c-1d54-41db-9b7b-28618bc96e61</serial>
Nov 08 14:11:52 user nova-compute[87365]: </disk>
Nov 08 14:11:52 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No VIF found with MAC fa:16:3e:5f:9b:43, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-34fe812f-f37d-4295-8d29-7b0eb89943ef tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.399s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:11:53 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:54 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:11:55 user nova-compute[87365]: INFO nova.compute.claims [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Claim successful on node user
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:11:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.policy [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:11:55 user nova-compute[87365]: INFO nova.virt.block_device [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Booting with volume d90fff52-7c64-4e39-9bf3-2c77bef47d64 at /dev/vda
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.utils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e009c2e-f2cf-4265-a9dc-a9d81fc2be8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7748b52-293c-457f-8bac-af7921c8b537]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc48e7-0b3c-47b2-a15c-e37a766fc8a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c94ea-c605-41ed-bc06-1a024e0527e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:55 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:11:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb2b6f-16c8-4665-a233-a43fa28f36e2]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG os_brick.utils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:55 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating existing volume attachment record: ca9c2d44-7c0a-4591-93ee-19442182abb7 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Successfully created port: 2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG nova.objects.instance [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:11:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:11:56 user nova-compute[87365]: INFO nova.compute.manager [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attaching volume a51995eb-4422-44f6-a953-1097a3876919 to /dev/vdc
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.utils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[659915e0-ccca-46ae-8ade-b812316d3e1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27d9aee-3a92-4554-b53d-28b11a28f833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Successfully updated port: 2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe394c53-cb9d-480c-91f4-6e6a18283ad8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[79913478-322e-48e8-88d6-b27b0226c02a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing instance network info cache due to event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] Acquiring lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:11:57 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf0f3a7-756b-4c74-a2b8-e59b5f7bfe9b]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG os_brick.utils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating existing volume attachment record: 9c08fb0c-311d-4b8b-99f6-8af9982feb23 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Instance network_info: |[{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] Acquired lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updated VIF entry in instance network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG nova.network.neutron [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:11:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-fa5b6d6f-ae25-4e9d-a77f-6cef6d308252 req-d29d1173-6044-4e6f-a1ad-2cc1861d51a9 service nova] Releasing lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:11:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:09 user nova-compute[87365]: INFO nova.compute.manager [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Detaching volume 691a6d7e-03af-47cf-b7a8-16414ed7f389
Nov 08 14:12:09 user nova-compute[87365]: INFO nova.virt.block_device [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Attempting to driver detach volume 691a6d7e-03af-47cf-b7a8-16414ed7f389 from mountpoint /dev/vdb
Nov 08 14:12:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Attempting to detach device vdb from instance 937e7773-8812-406a-87f3-48373678eeb1 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:12:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:12:09 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:09 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:12:09 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:12:09 user nova-compute[87365]:   <serial>691a6d7e-03af-47cf-b7a8-16414ed7f389</serial>
Nov 08 14:12:09 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 14:12:09 user nova-compute[87365]: </disk>
Nov 08 14:12:09 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:12:09 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdb from instance 937e7773-8812-406a-87f3-48373678eeb1 from the persistent domain config.
Nov 08 14:12:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937e7773-8812-406a-87f3-48373678eeb1 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:12:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:12:09 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:09 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:12:09 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:12:09 user nova-compute[87365]:   <serial>691a6d7e-03af-47cf-b7a8-16414ed7f389</serial>
Nov 08 14:12:09 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 14:12:09 user nova-compute[87365]: </disk>
Nov 08 14:12:09 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:12:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:12:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:12:19 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Creating image(s)
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Ensure instance console log exists: /opt/stack/data/nova/instances/3af78b19-8223-46fc-b8d4-a91a927cf8ee/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Start _get_guest_xml network_info=[{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3af78b19-8223-46fc-b8d4-a91a927cf8ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'd90fff52-7c64-4e39-9bf3-2c77bef47d64', 'serial': 'd90fff52-7c64-4e39-9bf3-2c77bef47d64'}, 'attachment_id': 'ca9c2d44-7c0a-4591-93ee-19442182abb7', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:12:19 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:12:19 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:12:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:20 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:20 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:20 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30bf30-476c-4c8a-95d9-b3f12e35aa21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:12:20 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[272ae7a2-b762-4c6b-b6fb-f614fc0a2b56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64] added
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a95f84-1fb4-489e-ba5d-af94e4a4cc68]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5e88b-3ac2-4e53-8c70-46f52808b098]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMBjURLa {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMBjURLa" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[383ca2f8-e676-47ef-9fa5-b788bd616d71]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMBjURLa'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b58cc48-4388-47f2-ac79-ab1eb26841ab]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a0547d-0840-4b93-b208-8500457d5e39]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a031442-dd24-4eee-a0a5-1714890f3e28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]
Nov 08 14:12:20 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[788103d9-afcb-48e8-8158-cbf35cbdb4b5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e795b-8993-4934-a72a-3e175d0b7a8e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:20 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc51463-2c04-40ea-b0d9-a0e7184c329b]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuakdhUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:20 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:20 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23336663033333263', 'path': '/dev/sdf'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336663033333263', 'path': '/dev/sdf'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.376s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:21 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fedba-4fe3-4f1f-a480-efdc36b38255]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:12:21 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408194928',display_name='tempest-TestVolumeBootPattern-server-408194928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-408194928',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-53u07dm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:11:56Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=3af78b19-8223-46fc-b8d4-a91a927cf8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.objects.instance [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid 3af78b19-8223-46fc-b8d4-a91a927cf8ee {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:12:21 user nova-compute[87365]:   <uuid>3af78b19-8223-46fc-b8d4-a91a927cf8ee</uuid>
Nov 08 14:12:21 user nova-compute[87365]:   <name>instance-0000002e</name>
Nov 08 14:12:21 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:12:21 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:12:21 user nova-compute[87365]:   <metadata>
Nov 08 14:12:21 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:12:21 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:12:21 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-server-408194928</nova:name>
Nov 08 14:12:21 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:12:19</nova:creationTime>
Nov 08 14:12:21 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:12:21 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:12:21 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:12:21 user nova-compute[87365]:       <nova:owner>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 14:12:21 user nova-compute[87365]:       </nova:owner>
Nov 08 14:12:21 user nova-compute[87365]:       <nova:ports>
Nov 08 14:12:21 user nova-compute[87365]:         <nova:port uuid="2ed96871-3c89-4d9d-9643-1d5c843f6f74">
Nov 08 14:12:21 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 14:12:21 user nova-compute[87365]:         </nova:port>
Nov 08 14:12:21 user nova-compute[87365]:       </nova:ports>
Nov 08 14:12:21 user nova-compute[87365]:     </nova:instance>
Nov 08 14:12:21 user nova-compute[87365]:   </metadata>
Nov 08 14:12:21 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:12:21 user nova-compute[87365]:     <system>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="serial">3af78b19-8223-46fc-b8d4-a91a927cf8ee</entry>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="uuid">3af78b19-8223-46fc-b8d4-a91a927cf8ee</entry>
Nov 08 14:12:21 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:12:21 user nova-compute[87365]:     </system>
Nov 08 14:12:21 user nova-compute[87365]:   </sysinfo>
Nov 08 14:12:21 user nova-compute[87365]:   <os>
Nov 08 14:12:21 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:12:21 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:12:21 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:12:21 user nova-compute[87365]:   </os>
Nov 08 14:12:21 user nova-compute[87365]:   <features>
Nov 08 14:12:21 user nova-compute[87365]:     <acpi/>
Nov 08 14:12:21 user nova-compute[87365]:     <apic/>
Nov 08 14:12:21 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:12:21 user nova-compute[87365]:   </features>
Nov 08 14:12:21 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:12:21 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:12:21 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:12:21 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:12:21 user nova-compute[87365]:   </clock>
Nov 08 14:12:21 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:12:21 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:12:21 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:12:21 user nova-compute[87365]:   </cpu>
Nov 08 14:12:21 user nova-compute[87365]:   <devices>
Nov 08 14:12:21 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:12:21 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:21 user nova-compute[87365]:       <source dev="/dev/sdf"/>
Nov 08 14:12:21 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:12:21 user nova-compute[87365]:       <serial>d90fff52-7c64-4e39-9bf3-2c77bef47d64</serial>
Nov 08 14:12:21 user nova-compute[87365]:     </disk>
Nov 08 14:12:21 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:12:21 user nova-compute[87365]:       <mac address="fa:16:3e:b3:26:41"/>
Nov 08 14:12:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:12:21 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:12:21 user nova-compute[87365]:       <target dev="tap2ed96871-3c"/>
Nov 08 14:12:21 user nova-compute[87365]:     </interface>
Nov 08 14:12:21 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:12:21 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/3af78b19-8223-46fc-b8d4-a91a927cf8ee/console.log" append="off"/>
Nov 08 14:12:21 user nova-compute[87365]:     </serial>
Nov 08 14:12:21 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:12:21 user nova-compute[87365]:     <video>
Nov 08 14:12:21 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:12:21 user nova-compute[87365]:     </video>
Nov 08 14:12:21 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:12:21 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:12:21 user nova-compute[87365]:     </rng>
Nov 08 14:12:21 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:12:21 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:12:21 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:12:21 user nova-compute[87365]:     </memballoon>
Nov 08 14:12:21 user nova-compute[87365]:   </devices>
Nov 08 14:12:21 user nova-compute[87365]: </domain>
Nov 08 14:12:21 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408194928',display_name='tempest-TestVolumeBootPattern-server-408194928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-408194928',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-53u07dm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:11:56Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=3af78b19-8223-46fc-b8d4-a91a927cf8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_vif [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab3f60f-38db-405f-bc38-76c622a135a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919] added
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02fa92eb-062d-5d2a-9658-81002674a51f', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ed96871-3c, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ed96871-3c, col_values=(('qos', UUID('bd418366-50fd-47f8-bedc-3b6476cf0568')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ed96871-3c, col_values=(('external_ids', {'iface-id': '2ed96871-3c89-4d9d-9643-1d5c843f6f74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:26:41', 'vm-uuid': '3af78b19-8223-46fc-b8d4-a91a927cf8ee'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c48b0a5-e7df-4d3f-ab33-76de98905eeb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:21 user nova-compute[87365]: INFO os_vif [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c')
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb998ed2-ef4d-425b-ad1f-72819e2da7cf]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuakdhUc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuakdhUc" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[63697dab-3cf1-4ca9-8783-98e83ce42f7d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuakdhUc'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:b3:26:41, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45ade1-0a22-4681-9027-ec9372285f34]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abdf3ce-3237-4966-8cc2-4c933602785a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be7f9ba-6460-4d65-8727-d0fd931508f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260]
Nov 08 14:12:21 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260] successful.
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d1dfd5-cc62-4bd2-ab7c-78390f53db4a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097a055-64d8-4166-84e1-a5ce1a9c8074]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796986b-9107-455f-b0ba-7e46e0924005]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:12:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuakdhUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== connect_volume: return (1696ms) {'type': 'block', 'scsi_wwn': '23761656536666237', 'path': '/dev/sdg'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761656536666237', 'path': '/dev/sdg'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:12:22 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:22 user nova-compute[87365]:   <source dev="/dev/sdg"/>
Nov 08 14:12:22 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:12:22 user nova-compute[87365]:   <serial>a51995eb-4422-44f6-a953-1097a3876919</serial>
Nov 08 14:12:22 user nova-compute[87365]: </disk>
Nov 08 14:12:22 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] No waiting events found dispatching network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:22 user nova-compute[87365]: WARNING nova.compute.manager [req-52348629-0dae-42b2-afd8-e1af31b34938 req-e17ca077-3991-4219-89f7-2d404a5cf65b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received unexpected event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 for instance with vm_state building and task_state spawning.
Nov 08 14:12:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] No VIF found with MAC fa:16:3e:5f:9b:43, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:12:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-91c076ad-cb5b-4d1d-8fe0-d84c35d99169 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.569s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:24 user nova-compute[87365]: INFO nova.compute.manager [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Detaching volume a51995eb-4422-44f6-a953-1097a3876919
Nov 08 14:12:24 user nova-compute[87365]: INFO nova.virt.block_device [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attempting to driver detach volume a51995eb-4422-44f6-a953-1097a3876919 from mountpoint /dev/vdc
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Attempting to detach device vdc from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:12:24 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:24 user nova-compute[87365]:   <source dev="/dev/sdg"/>
Nov 08 14:12:24 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:12:24 user nova-compute[87365]:   <serial>a51995eb-4422-44f6-a953-1097a3876919</serial>
Nov 08 14:12:24 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 14:12:24 user nova-compute[87365]: </disk>
Nov 08 14:12:24 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:12:24 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully detached device vdc from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the persistent domain config.
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:12:24 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:12:24 user nova-compute[87365]:   <source dev="/dev/sdg"/>
Nov 08 14:12:24 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:12:24 user nova-compute[87365]:   <serial>a51995eb-4422-44f6-a953-1097a3876919</serial>
Nov 08 14:12:24 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 14:12:24 user nova-compute[87365]: </disk>
Nov 08 14:12:24 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] No waiting events found dispatching network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:24 user nova-compute[87365]: WARNING nova.compute.manager [req-618ed194-4542-41d7-8e83-bfb055c8eea1 req-d6e44732-6923-4088-b605-9a12ca742b2b service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received unexpected event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 for instance with vm_state building and task_state spawning.
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:12:25 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Instance spawned successfully.
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:12:25 user nova-compute[87365]: INFO nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 08 14:12:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:12:25 user nova-compute[87365]: INFO nova.compute.manager [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Took 30.26 seconds to build instance.
Nov 08 14:12:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-712cc16c-c6dc-406b-b173-41b40005d4a9 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.354s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:29 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 937e7773-8812-406a-87f3-48373678eeb1 is timed out.
Nov 08 14:12:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdb from instance 937e7773-8812-406a-87f3-48373678eeb1 from the live domain config.
Nov 08 14:12:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjDKqTOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:29 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66ce47-a227-477a-a493-52f9e3a1713a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:12:29 user nova-compute[87365]: No targets found.
Nov 08 14:12:29 user nova-compute[87365]: iSNS:
Nov 08 14:12:29 user nova-compute[87365]: No targets found.
Nov 08 14:12:29 user nova-compute[87365]: STATIC:
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:12:29 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:29 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:29 user nova-compute[87365]: FIRMWARE:
Nov 08 14:12:29 user nova-compute[87365]: No targets found.
Nov 08 14:12:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:12:29 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:12:29 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd6582-e7c0-4631-af40-865d9579cd13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec41e0-7445-47c1-a0d6-51518a284f0f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d253bf6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f286cb30-2157-46a0-b808-2dac9f5318aa]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc5661-d147-42c3-a7d8-6e1838ffeea8]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4763535-5ee9-4637-babb-4d8d032736c7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[581891fc-df18-40b0-8bb6-b8125a07f2b2]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d039fdc-4615-40ff-9785-3a7fc3b3c63c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256fe5d-9aec-43f8-bce0-0f3f8193d790]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260]
Nov 08 14:12:30 user nova-compute[87365]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389, portal: 172.16.0.220,3260] successful.
Nov 08 14:12:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:691a6d7e-03af-47cf-b7a8-16414ed7f389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a40724-ba31-4903-a5e8-527f40ac5e20]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== disconnect_volume: return (323ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:12:30 user nova-compute[87365]: DEBUG nova.objects.instance [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-66d41b16-3c39-4e62-a94c-30802868d9f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=87365) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 14:12:31 user nova-compute[87365]: DEBUG nova.objects.instance [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:32 user nova-compute[87365]: WARNING nova.compute.manager [req-1e3d9b00-2eb8-4c84-a4c3-f6af2b9099cc req-f8c611cc-e26d-4a01-aa74-8dccc30ca48d service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state active and task_state powering-off.
Nov 08 14:12:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance destroyed successfully.
Nov 08 14:12:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:12:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-18efbfee-1944-4be0-a4c7-fd6f6500b153 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.856s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:34 user nova-compute[87365]: WARNING nova.compute.manager [req-a8f157bf-c703-47ed-baf6-15db8e09b80a req-47035523-7cf8-4177-bf71-f3a7ecbecab4 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state stopped and task_state None.
Nov 08 14:12:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:44 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 is timed out.
Nov 08 14:12:44 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully detached device vdc from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the live domain config.
Nov 08 14:12:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuakdhUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:44 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c40103-a040-4273-a042-36c815768df8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:12:44 user nova-compute[87365]: No targets found.
Nov 08 14:12:44 user nova-compute[87365]: iSNS:
Nov 08 14:12:44 user nova-compute[87365]: No targets found.
Nov 08 14:12:44 user nova-compute[87365]: STATIC:
Nov 08 14:12:44 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61
Nov 08 14:12:44 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:44 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:44 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:12:44 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:44 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:44 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:12:44 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:44 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:44 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919
Nov 08 14:12:44 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:44 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:44 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:12:44 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:44 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:44 user nova-compute[87365]: FIRMWARE:
Nov 08 14:12:44 user nova-compute[87365]: No targets found.
Nov 08 14:12:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:12:44 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:12:44 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2e9849-fa5e-4974-a3d0-e2c49ae5b0e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a813cc5-cafc-463d-a5f1-9533a25b2a7e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 (non-flash)
Nov 08 14:12:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4c19120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919'): ({'sdg'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Removing single pathed devices sdg {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[31568442-20a6-4d25-9c3b-f34d841fa456]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e57b66-ccec-4963-b911-2a7a1c6302bd]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Flushing IO for device /dev/sdg {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[22919aee-4666-43ee-a889-95e1c263ce49]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380abe4-5f56-4f62-b05a-03b752769c87]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] SCSI volumes sdg have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23424fa-77eb-4802-8fad-2d910ec99c9d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df506c-a5cb-47b7-bb9d-f71cddb17058]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260]
Nov 08 14:12:45 user nova-compute[87365]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919, portal: 172.16.0.220,3260] successful.
Nov 08 14:12:45 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51995eb-4422-44f6-a953-1097a3876919 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ebad1-f166-4eed-aeca-729b67f4f67e]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== disconnect_volume: return (294ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:45 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a812c88b-f75b-4944-bf66-a8e0d6d890ad tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing instance network info cache due to event network-changed-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:46 user nova-compute[87365]: DEBUG nova.network.neutron [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Refreshing network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:12:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated VIF entry in instance network info cache for port f9bd8195-16dc-48da-b0f6-c9980a7ebcaa. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:12:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3bcec775-d1de-44e4-8e06-c0f2ea42127b req-88d3209a-3a2b-4d84-81f9-7e24f1229ead service nova] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Stashing vm_state: active {{(pid=87365) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-changed-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Refreshing instance network info cache due to event network-changed-09286f0e-4961-4500-90f6-c6ba6470aeb5. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] Acquiring lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] Acquired lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.network.neutron [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Refreshing network info cache for port 09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:12:48 user nova-compute[87365]: INFO nova.compute.claims [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Claim successful on node user
Nov 08 14:12:48 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating resource usage from migration 0da8b45f-de05-483a-900a-a57e58671729
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.353s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:48 user nova-compute[87365]: INFO nova.compute.manager [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Migrating
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.211s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.network.neutron [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updated VIF entry in instance network info cache for port 09286f0e-4961-4500-90f6-c6ba6470aeb5. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG nova.network.neutron [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updating instance_info_cache with network_info: [{"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11ce0bdb-58a3-42ab-b917-c5b8657493a7 req-c3a8cfa6-3360-45fa-bc76-86db47af5257 service nova] Releasing lock "refresh_cache-a292ae64-23d2-4c99-9cc7-562656a06ead" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-changed-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Refreshing instance network info cache due to event network-changed-c3645578-72ef-4aad-905a-f1dbb769299d. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Refreshing network info cache for port c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Starting migrate_disk_and_power_off {{(pid=87365) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updated VIF entry in instance network info cache for port c3645578-72ef-4aad-905a-f1dbb769299d. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6cd9621c-d89d-4942-a3d6-9ae9790fe53c req-e3537a71-218b-4082-b0fa-733b7835d10e service nova] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:49 user nova-compute[87365]: INFO nova.compute.manager [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Terminating instance
Nov 08 14:12:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance destroyed successfully.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:11:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3645578-72, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa563125-0878-42b1-b243-9845d184c393) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: INFO os_vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72')
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:50 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a162c360-a83e-49f7-9f07-166a3550aa16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:12:50 user nova-compute[87365]: No targets found.
Nov 08 14:12:50 user nova-compute[87365]: iSNS:
Nov 08 14:12:50 user nova-compute[87365]: No targets found.
Nov 08 14:12:50 user nova-compute[87365]: STATIC:
Nov 08 14:12:50 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61
Nov 08 14:12:50 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:50 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:50 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:12:50 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:50 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:50 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:12:50 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:50 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:50 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:12:50 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:12:50 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:12:50 user nova-compute[87365]: FIRMWARE:
Nov 08 14:12:50 user nova-compute[87365]: No targets found.
Nov 08 14:12:50 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:12:50 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:12:50 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7bace-f663-401b-9f23-d41f6f51e52c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:50 user nova-compute[87365]: WARNING nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state active and task_state resize_migrating.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:50 user nova-compute[87365]: WARNING nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state active and task_state resize_migrating.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-unplugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] No waiting events found dispatching network-vif-unplugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-unplugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Acquiring lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] No waiting events found dispatching network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:12:50 user nova-compute[87365]: WARNING nova.compute.manager [req-d3e1efac-2a6f-4502-963d-78f586119c6e req-4d1d5ccf-6753-460b-9ef8-f2ddc68890a3 service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received unexpected event network-vif-plugged-09286f0e-4961-4500-90f6-c6ba6470aeb5 for instance with vm_state active and task_state deleting.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[59743b44-3f49-40f9-a222-6a30c03d4a27]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:12:50 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf86f7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e'): ({'sdd'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Removing single pathed devices sdd {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eacb7d-761b-4a2c-a134-8f3866f6cbb4]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90162ce-0dd3-41ca-9889-98b0a4f83c90]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flushing IO for device /dev/sdd {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c3b070-f7d8-4629-90a7-4862bfeed24a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Instance destroyed successfully.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'resources' on Instance uuid a292ae64-23d2-4c99-9cc7-562656a06ead {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1368960089',display_name='tempest-AttachVolumeNegativeTest-server-1368960089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1368960089',id=45,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHXHEQyODs15xakoAqw0Z7R0WCXGbG8jfRgXfWTkW5rMgjjTIPiH9kfQeFp5KZeIGzOrQIu84rtES1kJi/hwNQ6UhXHHjOX8gn80rXpbte3tPAK6Rn61aSmsdofftCJuQ==',key_name='tempest-keypair-1509162836',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:11:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-7ycsgnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=a292ae64-23d2-4c99-9cc7-562656a06ead,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "address": "fa:16:3e:c5:db:89", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09286f0e-49", "ovs_interfaceid": "09286f0e-4961-4500-90f6-c6ba6470aeb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_vif [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09286f0e-49, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f404c0e2-5dd6-40b5-bf0e-9d57be7a530e]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] SCSI volumes sdd have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=698fd01d-b442-4080-b36a-679efb82e295) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: INFO os_vif [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:db:89,bridge_name='br-int',has_traffic_filtering=True,id=09286f0e-4961-4500-90f6-c6ba6470aeb5,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09286f0e-49')
Nov 08 14:12:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Deleting instance files /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead_del
Nov 08 14:12:50 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Deletion of /opt/stack/data/nova/instances/a292ae64-23d2-4c99-9cc7-562656a06ead_del complete
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670739f-8e7b-4ee4-ab54-02fa4d7379c0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: INFO nova.compute.manager [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ee7b7-ee40-40b2-b073-3a03d9730b0f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]
Nov 08 14:12:50 user nova-compute[87365]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.
Nov 08 14:12:50 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c023c0e-ca0b-418c-ae38-77a7f35a982d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== disconnect_volume: return (434ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:12:51 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:12:51 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=24.283199310302734GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Applying migration context for instance d2dec940-66be-4a6e-a3cb-3782788b3d36 as it has an incoming, in-progress migration 0da8b45f-de05-483a-900a-a57e58671729. Migration status is migrating {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 14:12:51 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating resource usage from migration 0da8b45f-de05-483a-900a-a57e58671729
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance a292ae64-23d2-4c99-9cc7-562656a06ead actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Migration 0da8b45f-de05-483a-900a-a57e58671729 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:51 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Took 0.87 seconds to deallocate network for instance.
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-f04e9fe6-bdbf-4bb6-ba1b-c4a30ff36b9d req-6801c863-f75b-49b0-a833-3aa6537f0dba service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Received event network-vif-deleted-09286f0e-4961-4500-90f6-c6ba6470aeb5 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:12:51 user nova-compute[87365]: INFO nova.compute.manager [req-f04e9fe6-bdbf-4bb6-ba1b-c4a30ff36b9d req-6801c863-f75b-49b0-a833-3aa6537f0dba service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Neutron deleted interface 09286f0e-4961-4500-90f6-c6ba6470aeb5; detaching it from the instance and deleting it from the info cache
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-f04e9fe6-bdbf-4bb6-ba1b-c4a30ff36b9d req-6801c863-f75b-49b0-a833-3aa6537f0dba service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-f04e9fe6-bdbf-4bb6-ba1b-c4a30ff36b9d req-6801c863-f75b-49b0-a833-3aa6537f0dba service nova] [instance: a292ae64-23d2-4c99-9cc7-562656a06ead] Detach interface failed, port_id=09286f0e-4961-4500-90f6-c6ba6470aeb5, reason: Instance a292ae64-23d2-4c99-9cc7-562656a06ead could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Port c3645578-72ef-4aad-905a-f1dbb769299d binding to destination host user is already ACTIVE {{(pid=87365) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:52 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Deleted allocations for instance a292ae64-23d2-4c99-9cc7-562656a06ead
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9d8210f3-8b30-41ea-b858-37bcceadfafe tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "a292ae64-23d2-4c99-9cc7-562656a06ead" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG nova.network.neutron [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.utils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e283cb0-6fcf-4556-bae8-ef27269bf9c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864364e-2b3c-49ab-a690-8cf6ded3a495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd47d3-aa47-4ea7-be6e-0dda74c8354f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d416e50-7ee3-482d-928a-a1ff5ca60672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:12:52 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:12:52 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a17fa0-2944-497e-be24-9c4e4aea616e]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:12:52 user nova-compute[87365]: DEBUG os_brick.utils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:12:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:12:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:12:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:12:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:12:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:12:54 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:12:55 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:12:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:12:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:12:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:12:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:14 user nova-compute[87365]: INFO nova.compute.manager [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Detaching volume 22a09c4c-1d54-41db-9b7b-28618bc96e61
Nov 08 14:13:14 user nova-compute[87365]: INFO nova.virt.block_device [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Attempting to driver detach volume 22a09c4c-1d54-41db-9b7b-28618bc96e61 from mountpoint /dev/vdb
Nov 08 14:13:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Attempting to detach device vdb from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:13:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:13:14 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:13:14 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:13:14 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:13:14 user nova-compute[87365]:   <serial>22a09c4c-1d54-41db-9b7b-28618bc96e61</serial>
Nov 08 14:13:14 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:13:14 user nova-compute[87365]: </disk>
Nov 08 14:13:14 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:13:14 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully detached device vdb from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the persistent domain config.
Nov 08 14:13:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:13:14 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:13:14 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:13:14 user nova-compute[87365]:   <source dev="/dev/sde"/>
Nov 08 14:13:14 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:13:14 user nova-compute[87365]:   <serial>22a09c4c-1d54-41db-9b7b-28618bc96e61</serial>
Nov 08 14:13:14 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:13:14 user nova-compute[87365]: </disk>
Nov 08 14:13:14 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Starting finish_migration {{(pid=87365) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance directory exists: not creating {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 14:13:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Creating image(s)
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Ensure instance console log exists: /opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start _get_guest_xml network_info=[{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd2dec940-66be-4a6e-a3cb-3782788b3d36', 'attached_at': '2023-11-08T14:13:16.000000', 'detached_at': '', 'volume_id': '03d67d33-8bac-450a-a31e-515552b0351e', 'serial': '03d67d33-8bac-450a-a31e-515552b0351e'}, 'attachment_id': '2b249b26-1689-4f91-b130-70753f1ff5ad', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:13:15 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:13:15 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:13:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:13:15 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:13:15 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:13:15 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c36b744-2cc4-4f0a-9209-b1a00812c879]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:13:15 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9baf17-95f3-4382-b842-2d886addcd2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e] added
Nov 08 14:13:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[856f3b35-a152-4f12-8eb0-78bf7c475af7]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4378f15-056f-4e68-bf20-1d55f5a01997]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHWNyusb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHWNyusb" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d592e93c-eb17-4761-af1a-7c41001a2d9c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHWNyusb'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1941d-dd0f-4a6a-8e58-119685337cef]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7fccb8-f59c-48fe-8be5-85dc148490d1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:15 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:13:15 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[945392d5-5ee7-4446-98a7-af6943fcbd71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]
Nov 08 14:13:16 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.
Nov 08 14:13:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a057a85-1a6c-41dc-8b57-0911ab538ba6]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96bd1a6-b3ab-4bc9-9294-919dcd9a2dc2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:13:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:16 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:13:16 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0b8a81-96af-4c94-8d4f-02a4630ca78e]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:13:16 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23737306164363065', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737306164363065', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:11:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:13:17 user nova-compute[87365]:   <uuid>d2dec940-66be-4a6e-a3cb-3782788b3d36</uuid>
Nov 08 14:13:17 user nova-compute[87365]:   <name>instance-0000002c</name>
Nov 08 14:13:17 user nova-compute[87365]:   <memory>2097152</memory>
Nov 08 14:13:17 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:13:17 user nova-compute[87365]:   <metadata>
Nov 08 14:13:17 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:13:17 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:13:17 user nova-compute[87365]:       <nova:name>tempest-ServerActionsTestOtherA-server-721364548</nova:name>
Nov 08 14:13:17 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:13:15</nova:creationTime>
Nov 08 14:13:17 user nova-compute[87365]:       <nova:flavor name="m1.small">
Nov 08 14:13:17 user nova-compute[87365]:         <nova:memory>2048</nova:memory>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:disk>20</nova:disk>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:13:17 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:13:17 user nova-compute[87365]:       <nova:owner>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:user uuid="33521b67405a405f912d0879b3d77829">tempest-ServerActionsTestOtherA-777028083-project-member</nova:user>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:project uuid="90a890ce53c34008a7a872f409fe4550">tempest-ServerActionsTestOtherA-777028083</nova:project>
Nov 08 14:13:17 user nova-compute[87365]:       </nova:owner>
Nov 08 14:13:17 user nova-compute[87365]:       <nova:ports>
Nov 08 14:13:17 user nova-compute[87365]:         <nova:port uuid="c3645578-72ef-4aad-905a-f1dbb769299d">
Nov 08 14:13:17 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 14:13:17 user nova-compute[87365]:         </nova:port>
Nov 08 14:13:17 user nova-compute[87365]:       </nova:ports>
Nov 08 14:13:17 user nova-compute[87365]:     </nova:instance>
Nov 08 14:13:17 user nova-compute[87365]:   </metadata>
Nov 08 14:13:17 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:13:17 user nova-compute[87365]:     <system>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="serial">d2dec940-66be-4a6e-a3cb-3782788b3d36</entry>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="uuid">d2dec940-66be-4a6e-a3cb-3782788b3d36</entry>
Nov 08 14:13:17 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:13:17 user nova-compute[87365]:     </system>
Nov 08 14:13:17 user nova-compute[87365]:   </sysinfo>
Nov 08 14:13:17 user nova-compute[87365]:   <os>
Nov 08 14:13:17 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:13:17 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:13:17 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:13:17 user nova-compute[87365]:   </os>
Nov 08 14:13:17 user nova-compute[87365]:   <features>
Nov 08 14:13:17 user nova-compute[87365]:     <acpi/>
Nov 08 14:13:17 user nova-compute[87365]:     <apic/>
Nov 08 14:13:17 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:13:17 user nova-compute[87365]:   </features>
Nov 08 14:13:17 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:13:17 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:13:17 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:13:17 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:13:17 user nova-compute[87365]:   </clock>
Nov 08 14:13:17 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:13:17 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:13:17 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:13:17 user nova-compute[87365]:   </cpu>
Nov 08 14:13:17 user nova-compute[87365]:   <devices>
Nov 08 14:13:17 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:13:17 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:13:17 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 14:13:17 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:13:17 user nova-compute[87365]:       <serial>03d67d33-8bac-450a-a31e-515552b0351e</serial>
Nov 08 14:13:17 user nova-compute[87365]:     </disk>
Nov 08 14:13:17 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:13:17 user nova-compute[87365]:       <mac address="fa:16:3e:b1:da:02"/>
Nov 08 14:13:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:13:17 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:13:17 user nova-compute[87365]:       <target dev="tapc3645578-72"/>
Nov 08 14:13:17 user nova-compute[87365]:     </interface>
Nov 08 14:13:17 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:13:17 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36/console.log" append="off"/>
Nov 08 14:13:17 user nova-compute[87365]:     </serial>
Nov 08 14:13:17 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:13:17 user nova-compute[87365]:     <video>
Nov 08 14:13:17 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:13:17 user nova-compute[87365]:     </video>
Nov 08 14:13:17 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:13:17 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:13:17 user nova-compute[87365]:     </rng>
Nov 08 14:13:17 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:13:17 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:13:17 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:13:17 user nova-compute[87365]:     </memballoon>
Nov 08 14:13:17 user nova-compute[87365]:   </devices>
Nov 08 14:13:17 user nova-compute[87365]: </domain>
Nov 08 14:13:17 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:11:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2144194722-network", "vif_mac": "fa:16:3e:b1:da:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG os_vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '786f3d3d-e85e-5ff2-b9a2-0a18d23a632e', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3645578-72, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3645578-72, col_values=(('qos', UUID('4e787b3b-abed-4652-8f07-9921606d1188')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3645578-72, col_values=(('external_ids', {'iface-id': 'c3645578-72ef-4aad-905a-f1dbb769299d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:da:02', 'vm-uuid': 'd2dec940-66be-4a6e-a3cb-3782788b3d36'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:17 user nova-compute[87365]: INFO os_vif [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72')
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:13:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] No VIF found with MAC fa:16:3e:b1:da:02, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:13:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:13:19 user nova-compute[87365]: WARNING nova.compute.manager [req-0d49e9b8-a9e1-40e7-a276-59a599f407c3 req-2a567241-6150-42aa-98a1-dfe67b2bd8e0 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state active and task_state resize_finish.
Nov 08 14:13:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:13:20 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance running successfully.
Nov 08 14:13:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Failed to set time: agent not configured {{(pid=87365) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 14:13:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-8b4fea7f-2ec6-44c8-a419-8aa48352557a tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] finish_migration finished successfully. {{(pid=87365) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 14:13:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:13:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:13:21 user nova-compute[87365]: WARNING nova.compute.manager [req-f83b48be-905f-42cd-99ba-8c34cb5c2489 req-8278cb54-6364-4132-b0da-5dac45d38406 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state resized and task_state None.
Nov 08 14:13:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:13:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 is timed out.
Nov 08 14:13:35 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully detached device vdb from instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 from the live domain config.
Nov 08 14:13:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IACOcMWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:13:35 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aecc096-8ed4-430c-9add-7c86fdec50d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:13:35 user nova-compute[87365]: No targets found.
Nov 08 14:13:35 user nova-compute[87365]: iSNS:
Nov 08 14:13:35 user nova-compute[87365]: No targets found.
Nov 08 14:13:35 user nova-compute[87365]: STATIC:
Nov 08 14:13:35 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61
Nov 08 14:13:35 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:13:35 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:13:35 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:13:35 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:13:35 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:13:35 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:13:35 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:13:35 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:13:35 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:13:35 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:13:35 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:13:35 user nova-compute[87365]: FIRMWARE:
Nov 08 14:13:35 user nova-compute[87365]: No targets found.
Nov 08 14:13:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:13:35 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:13:35 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d32635-fe1c-4e83-beae-900acd9fb15f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2335e8-83f3-4b27-991f-9bbe52c278d3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:13:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:13:35 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:13:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d24e1a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61'): ({'sde'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Removing single pathed devices sde {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde7e21-abfc-4101-883b-d91c34d5ecdd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2055eb-519a-4b32-92db-4e6ed8679a52]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Flushing IO for device /dev/sde {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e0612b-494f-4afe-a9e0-62f56369a763]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e163a4-0d1a-41f8-bcc3-50b8283a7bd5]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] SCSI volumes sde have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0501e356-c4c7-48f0-bb9d-0f0ff2bbd16f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18b24d4-16fe-4096-8054-4b50e07c9ba6]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260]
Nov 08 14:13:35 user nova-compute[87365]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61, portal: 172.16.0.220,3260] successful.
Nov 08 14:13:35 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22a09c4c-1d54-41db-9b7b-28618bc96e61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7847a90-0a18-4fd6-8f44-1da45dab0ae9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] <== disconnect_volume: return (304ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:13:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:13:36 user nova-compute[87365]: DEBUG nova.objects.instance [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'flavor' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:13:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9ee03593-1ff1-489d-b7b3-a02cdda3ef8e tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.044s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:13:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:38 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:41 user nova-compute[87365]: INFO nova.compute.manager [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Detaching volume a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:13:41 user nova-compute[87365]: INFO nova.virt.block_device [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Attempting to driver detach volume a8060cd2-6d78-42f1-9816-f61631116af5 from mountpoint /dev/vdb
Nov 08 14:13:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Attempting to detach device vdb from instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:13:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:13:41 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:13:41 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:13:41 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:13:41 user nova-compute[87365]:   <serial>a8060cd2-6d78-42f1-9816-f61631116af5</serial>
Nov 08 14:13:41 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:13:41 user nova-compute[87365]: </disk>
Nov 08 14:13:41 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:13:41 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 from the persistent domain config.
Nov 08 14:13:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:13:41 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:13:41 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:13:41 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:13:41 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:13:41 user nova-compute[87365]:   <serial>a8060cd2-6d78-42f1-9816-f61631116af5</serial>
Nov 08 14:13:41 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:13:41 user nova-compute[87365]: </disk>
Nov 08 14:13:41 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:13:42 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:13:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:13:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing instance network info cache due to event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:13:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] Acquiring lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:13:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] Acquired lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:13:46 user nova-compute[87365]: DEBUG nova.network.neutron [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:13:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updated VIF entry in instance network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:13:47 user nova-compute[87365]: DEBUG nova.network.neutron [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:13:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f1f8303c-3707-464c-a8e6-6cb27aced0ed req-010fb7ef-4a0d-4f9f-9553-426fe2ed6fce service nova] Releasing lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:13:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:13:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:13:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=24.308826446533203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Applying migration context for instance d2dec940-66be-4a6e-a3cb-3782788b3d36 as it has an incoming, in-progress migration 0da8b45f-de05-483a-900a-a57e58671729. Migration status is finished {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 14:13:50 user nova-compute[87365]: INFO nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating resource usage from migration 0da8b45f-de05-483a-900a-a57e58671729
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Migration 0da8b45f-de05-483a-900a-a57e58671729 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:13:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:13:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:13:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:13:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:13:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:13:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:13:55 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:13:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating instance_info_cache with network_info: [{"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:13:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-8449ebf2-af28-4fa2-8d18-5550729f9e93" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:13:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:13:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:13:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:02 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 is timed out.
Nov 08 14:14:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance 8449ebf2-af28-4fa2-8d18-5550729f9e93 from the live domain config.
Nov 08 14:14:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNGfKuWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:14:02 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6febbd-bd3f-426b-adc4-3f1e6fc91a36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:14:02 user nova-compute[87365]: No targets found.
Nov 08 14:14:02 user nova-compute[87365]: iSNS:
Nov 08 14:14:02 user nova-compute[87365]: No targets found.
Nov 08 14:14:02 user nova-compute[87365]: STATIC:
Nov 08 14:14:02 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5
Nov 08 14:14:02 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:14:02 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:14:02 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:14:02 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:14:02 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:14:02 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:14:02 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:14:02 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:14:02 user nova-compute[87365]: FIRMWARE:
Nov 08 14:14:02 user nova-compute[87365]: No targets found.
Nov 08 14:14:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:14:02 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:14:02 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9801eac-57ca-450b-948e-848f50c6e12b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f960417-85ef-477d-99f9-083f8efd3208]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:14:02 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:02 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 (non-flash)
Nov 08 14:14:02 user nova-compute[87365]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:02 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4ef1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2aac4-b193-44f8-9032-a9aca8848020]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ae5b6-ec19-4609-83e8-eda1e7c76132]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabffb9-0c0a-4e42-86d3-01ab55ecfbbb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7521fc9-531e-406c-b83d-d2dc3546e494]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c0a71-0207-498f-b41f-cbd655bb5534]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c8b09-de94-4a98-9def-324902d4e0a4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260]
Nov 08 14:14:02 user nova-compute[87365]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5, portal: 172.16.0.220,3260] successful.
Nov 08 14:14:02 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8060cd2-6d78-42f1-9816-f61631116af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1ec89-77df-47a0-aa23-fd5f3e2188be]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== disconnect_volume: return (301ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:14:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:03 user nova-compute[87365]: DEBUG nova.objects.instance [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-08809e63-ff7d-447d-8a36-02dc965e8250 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:05 user nova-compute[87365]: INFO nova.compute.manager [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Terminating instance
Nov 08 14:14:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-unplugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] No waiting events found dispatching network-vif-unplugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:05 user nova-compute[87365]: DEBUG nova.compute.manager [req-e1c4bfb9-bed9-479f-a1c5-a811dc53249c req-ae59f8bb-ac01-40fe-ae09-db7063d8315c service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-unplugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Instance destroyed successfully.
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.objects.instance [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lazy-loading 'resources' on Instance uuid 0d1e3f3b-3789-44d0-853a-d8e886a536f7 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1843809769',display_name='tempest-TestServerVolumeAttachmentScenario-server-1843809769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1843809769',id=43,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl/nVBWmIrXpDicXzzyyHfcGqmeCJ8Tz1bqfbM9IJWkUFhGVv/8/A4XI3zYaddH5nYoTFXHBtsVU7iGxQ70dnn+ixg7WokfmupTVtcorJQTbgOBxCeKGDUE4iIkYegZkw==',key_name='tempest-keypair-137767196',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972331944149427c988c65d7292663a4',ramdisk_id='',reservation_id='r-25cg4jag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-905729236',owner_user_name='tempest-TestServerVolumeAttachmentScenario-905729236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977805499d10433a8eef4c91d04dabf2',uuid=0d1e3f3b-3789-44d0-853a-d8e886a536f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converting VIF {"id": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "address": "fa:16:3e:5f:9b:43", "network": {"id": "36ddff42-2c89-4211-a39a-b180b2424f05", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-564308476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972331944149427c988c65d7292663a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51d6cd01-6d", "ovs_interfaceid": "51d6cd01-6d74-4edb-8515-5c4fa186f861", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG os_vif [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51d6cd01-6d, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b1f964f-da88-4886-9381-4f599ae69f4e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:06 user nova-compute[87365]: INFO os_vif [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:9b:43,bridge_name='br-int',has_traffic_filtering=True,id=51d6cd01-6d74-4edb-8515-5c4fa186f861,network=Network(36ddff42-2c89-4211-a39a-b180b2424f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51d6cd01-6d')
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Deleting instance files /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7_del
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Deletion of /opt/stack/data/nova/instances/0d1e3f3b-3789-44d0-853a-d8e886a536f7_del complete
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.compute.manager [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 14:14:06 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.compute.claims [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Claim successful on node user
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Took 0.71 seconds to deallocate network for instance.
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-3547b9a6-5926-42d2-a6f2-2f5fcfb4207c req-2a15d4de-2237-4923-a50c-234a1732f1bd service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-deleted-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:06 user nova-compute[87365]: INFO nova.compute.manager [req-3547b9a6-5926-42d2-a6f2-2f5fcfb4207c req-2a15d4de-2237-4923-a50c-234a1732f1bd service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Neutron deleted interface 51d6cd01-6d74-4edb-8515-5c4fa186f861; detaching it from the instance and deleting it from the info cache
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.network.neutron [req-3547b9a6-5926-42d2-a6f2-2f5fcfb4207c req-2a15d4de-2237-4923-a50c-234a1732f1bd service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:06 user nova-compute[87365]: DEBUG nova.compute.manager [req-3547b9a6-5926-42d2-a6f2-2f5fcfb4207c req-2a15d4de-2237-4923-a50c-234a1732f1bd service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Detach interface failed, port_id=51d6cd01-6d74-4edb-8515-5c4fa186f861, reason: Instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.046s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:14:07 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.policy [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19773693ca345709379304f9e6f0772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72686a705c7447abb29d45ccec5a3c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:14:07 user nova-compute[87365]: INFO nova.virt.block_device [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Booting with volume 6acaf64c-6038-419d-a4eb-c31f8cfefe3c at /dev/vda
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.utils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5096cc-404c-4c5f-940b-974fb8b00b68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51f542a-89da-40b8-b7c2-2d60fbaa0e79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c902a-52d3-4603-bc7b-d0e73045ac3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1b1fa-3b64-4720-b815-4545105d4d26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:14:07 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Deleted allocations for instance 0d1e3f3b-3789-44d0-853a-d8e886a536f7
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:14:07 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c69f8f-fe4c-419f-bea3-b9b7a28e2ec8]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG os_brick.utils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating existing volume attachment record: f7372e4d-1d60-4004-8274-51e2495d3b0b {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-f016512e-20f5-4ecf-84b0-7aac414e6f85 tempest-TestServerVolumeAttachmentScenario-905729236 tempest-TestServerVolumeAttachmentScenario-905729236-project-member] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] Acquiring lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] Lock "0d1e3f3b-3789-44d0-853a-d8e886a536f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] No waiting events found dispatching network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:07 user nova-compute[87365]: WARNING nova.compute.manager [req-8cdeaf76-c8d0-48c6-b620-90aab3390ac3 req-e0e53cb1-9900-4866-9bbf-cc8404ac1f39 service nova] [instance: 0d1e3f3b-3789-44d0-853a-d8e886a536f7] Received unexpected event network-vif-plugged-51d6cd01-6d74-4edb-8515-5c4fa186f861 for instance with vm_state deleted and task_state None.
Nov 08 14:14:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Successfully created port: a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Successfully updated port: a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquired lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating instance_info_cache with network_info: [{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Releasing lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Instance network_info: |[{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-changed-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.compute.manager [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing instance network info cache due to event network-changed-a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] Acquiring lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] Acquired lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:14:08 user nova-compute[87365]: DEBUG nova.network.neutron [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing network info cache for port a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:14:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updated VIF entry in instance network info cache for port a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:14:09 user nova-compute[87365]: DEBUG nova.network.neutron [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating instance_info_cache with network_info: [{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1686ba02-5311-436b-b526-c10e008adcaa req-f5aa7cfa-3247-4394-93ff-5e5539245571 service nova] Releasing lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:14:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:14:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquired lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'info_cache' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:22 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.network.neutron [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Releasing lock "refresh_cache-937e7773-8812-406a-87f3-48373678eeb1" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:14:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance destroyed successfully.
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'resources' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG os_vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37bcfa01-a2, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3753064-c6da-4d0e-9391-177025c5aed7) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:23 user nova-compute[87365]: INFO os_vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start _get_guest_xml network_info=[{"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'numa_topology' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:23 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'vcpu_model' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'pci_devices' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:14:23 user nova-compute[87365]:   <uuid>937e7773-8812-406a-87f3-48373678eeb1</uuid>
Nov 08 14:14:23 user nova-compute[87365]:   <name>instance-00000028</name>
Nov 08 14:14:23 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:14:23 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:14:23 user nova-compute[87365]:   <metadata>
Nov 08 14:14:23 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:14:23 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeTestJSON-server-1435204684</nova:name>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:14:23</nova:creationTime>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:14:23 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:14:23 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:owner>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:user uuid="c8951eb125524b84a913e2e66e857fbc">tempest-AttachVolumeTestJSON-1235364264-project-member</nova:user>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:project uuid="2c632e7ef13f4b03b843ce2996ecd29f">tempest-AttachVolumeTestJSON-1235364264</nova:project>
Nov 08 14:14:23 user nova-compute[87365]:       </nova:owner>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:14:23 user nova-compute[87365]:       <nova:ports>
Nov 08 14:14:23 user nova-compute[87365]:         <nova:port uuid="37bcfa01-a258-4259-8c18-44119de8d394">
Nov 08 14:14:23 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:14:23 user nova-compute[87365]:         </nova:port>
Nov 08 14:14:23 user nova-compute[87365]:       </nova:ports>
Nov 08 14:14:23 user nova-compute[87365]:     </nova:instance>
Nov 08 14:14:23 user nova-compute[87365]:   </metadata>
Nov 08 14:14:23 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:14:23 user nova-compute[87365]:     <system>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="serial">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="uuid">937e7773-8812-406a-87f3-48373678eeb1</entry>
Nov 08 14:14:23 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:14:23 user nova-compute[87365]:     </system>
Nov 08 14:14:23 user nova-compute[87365]:   </sysinfo>
Nov 08 14:14:23 user nova-compute[87365]:   <os>
Nov 08 14:14:23 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:14:23 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:14:23 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:14:23 user nova-compute[87365]:   </os>
Nov 08 14:14:23 user nova-compute[87365]:   <features>
Nov 08 14:14:23 user nova-compute[87365]:     <acpi/>
Nov 08 14:14:23 user nova-compute[87365]:     <apic/>
Nov 08 14:14:23 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:14:23 user nova-compute[87365]:   </features>
Nov 08 14:14:23 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:14:23 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:14:23 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:14:23 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:14:23 user nova-compute[87365]:   </clock>
Nov 08 14:14:23 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:14:23 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:14:23 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:14:23 user nova-compute[87365]:   </cpu>
Nov 08 14:14:23 user nova-compute[87365]:   <devices>
Nov 08 14:14:23 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:14:23 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:14:23 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk"/>
Nov 08 14:14:23 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:14:23 user nova-compute[87365]:     </disk>
Nov 08 14:14:23 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:14:23 user nova-compute[87365]:       <mac address="fa:16:3e:65:e2:8a"/>
Nov 08 14:14:23 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:14:23 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:14:23 user nova-compute[87365]:       <target dev="tap37bcfa01-a2"/>
Nov 08 14:14:23 user nova-compute[87365]:     </interface>
Nov 08 14:14:23 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:14:23 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/console.log" append="off"/>
Nov 08 14:14:23 user nova-compute[87365]:     </serial>
Nov 08 14:14:23 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:14:23 user nova-compute[87365]:     <video>
Nov 08 14:14:23 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:14:23 user nova-compute[87365]:     </video>
Nov 08 14:14:23 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:14:23 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:14:23 user nova-compute[87365]:     </rng>
Nov 08 14:14:23 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:14:23 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:14:23 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:14:23 user nova-compute[87365]:     </memballoon>
Nov 08 14:14:23 user nova-compute[87365]:   </devices>
Nov 08 14:14:23 user nova-compute[87365]: </domain>
Nov 08 14:14:23 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'trusted_certs' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:14:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Cannot resize image /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.objects.instance [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'migration_context' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.objects.base [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Object Instance<937e7773-8812-406a-87f3-48373678eeb1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG os_vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a3d642f-e5cb-56bc-8929-a20462c4051d', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37bcfa01-a2, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37bcfa01-a2, col_values=(('qos', UUID('7711664d-7e6c-4b03-9d69-cdd6a2239ee7')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37bcfa01-a2, col_values=(('external_ids', {'iface-id': '37bcfa01-a258-4259-8c18-44119de8d394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:e2:8a', 'vm-uuid': '937e7773-8812-406a-87f3-48373678eeb1'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:24 user nova-compute[87365]: INFO os_vif [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:14:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:25 user nova-compute[87365]: WARNING nova.compute.manager [req-8ce1dc80-47c6-48f7-9fe1-c951e7d05db3 req-8a0b4916-6330-4456-89de-f7902f52a517 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state stopped and task_state powering-on.
Nov 08 14:14:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:26 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:14:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance rebooted successfully.
Nov 08 14:14:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-5e0b9c39-b58c-454c-8778-fdc02d2a0926 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:27 user nova-compute[87365]: DEBUG nova.compute.manager [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:27 user nova-compute[87365]: WARNING nova.compute.manager [req-5c92f102-c223-45d8-a065-d0fcca2344fe req-7e0f33df-c910-4b16-91d5-2d10297c0f2e service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state active and task_state None.
Nov 08 14:14:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:14:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Creating image(s)
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Did not create local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Ensure instance console log exists: /opt/stack/data/nova/instances/68c5295b-1adc-4765-a07d-183ab13e2921/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Start _get_guest_xml network_info=[{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LryZjaIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68c5295b-1adc-4765-a07d-183ab13e2921', 'attached_at': '', 'detached_at': '', 'volume_id': '6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 'serial': '6acaf64c-6038-419d-a4eb-c31f8cfefe3c'}, 'attachment_id': 'f7372e4d-1d60-4004-8274-51e2495d3b0b', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:14:29 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:29 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LryZjaIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:14:29 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:14:29 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:14:29 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f5afa8-9f05-4f9d-89d1-c97efb7d7d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:14:29 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8776a22a-3326-47fb-a017-26cd423b7168]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c] added
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[26146d23-8c4e-4c93-84d2-5065a9ca0c48]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721e1df-acfc-4a7c-8fbc-2ead4b155904]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LryZjaIw {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LryZjaIw" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df8741-3c66-473c-81d0-bbbd4c761811]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LryZjaIw'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba15775-e242-41aa-a1ef-ccd35f281839]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a58d7f6-14d5-4928-a16c-001558d9e786]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fcd4a-516c-4289-b709-a3d4ca348425]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260]
Nov 08 14:14:29 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260] successful.
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e8985-1da6-437d-a29e-776e726a02c0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baf1514-6cf3-4063-943a-836423d3c7f6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:14:29 user nova-compute[87365]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)
Nov 08 14:14:29 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d707ee-7901-4555-ac9e-b48143e75d07]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:14:29 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LryZjaIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23764646633326538', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764646633326538', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290377410',display_name='tempest-TestVolumeBootPattern-server-290377410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290377410',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-94er0ytz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:14:07Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=68c5295b-1adc-4765-a07d-183ab13e2921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:30 user nova-compute[87365]: DEBUG nova.objects.instance [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c5295b-1adc-4765-a07d-183ab13e2921 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:14:31 user nova-compute[87365]:   <uuid>68c5295b-1adc-4765-a07d-183ab13e2921</uuid>
Nov 08 14:14:31 user nova-compute[87365]:   <name>instance-0000002f</name>
Nov 08 14:14:31 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:14:31 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:14:31 user nova-compute[87365]:   <metadata>
Nov 08 14:14:31 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:14:31 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:14:31 user nova-compute[87365]:       <nova:name>tempest-TestVolumeBootPattern-server-290377410</nova:name>
Nov 08 14:14:31 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:14:29</nova:creationTime>
Nov 08 14:14:31 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:14:31 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:14:31 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:14:31 user nova-compute[87365]:       <nova:owner>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:user uuid="a19773693ca345709379304f9e6f0772">tempest-TestVolumeBootPattern-596681261-project-member</nova:user>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:project uuid="72686a705c7447abb29d45ccec5a3c1f">tempest-TestVolumeBootPattern-596681261</nova:project>
Nov 08 14:14:31 user nova-compute[87365]:       </nova:owner>
Nov 08 14:14:31 user nova-compute[87365]:       <nova:ports>
Nov 08 14:14:31 user nova-compute[87365]:         <nova:port uuid="a37f86ed-b801-419c-af71-fdfece84679b">
Nov 08 14:14:31 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 14:14:31 user nova-compute[87365]:         </nova:port>
Nov 08 14:14:31 user nova-compute[87365]:       </nova:ports>
Nov 08 14:14:31 user nova-compute[87365]:     </nova:instance>
Nov 08 14:14:31 user nova-compute[87365]:   </metadata>
Nov 08 14:14:31 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:14:31 user nova-compute[87365]:     <system>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="serial">68c5295b-1adc-4765-a07d-183ab13e2921</entry>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="uuid">68c5295b-1adc-4765-a07d-183ab13e2921</entry>
Nov 08 14:14:31 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:14:31 user nova-compute[87365]:     </system>
Nov 08 14:14:31 user nova-compute[87365]:   </sysinfo>
Nov 08 14:14:31 user nova-compute[87365]:   <os>
Nov 08 14:14:31 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:14:31 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:14:31 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:14:31 user nova-compute[87365]:   </os>
Nov 08 14:14:31 user nova-compute[87365]:   <features>
Nov 08 14:14:31 user nova-compute[87365]:     <acpi/>
Nov 08 14:14:31 user nova-compute[87365]:     <apic/>
Nov 08 14:14:31 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:14:31 user nova-compute[87365]:   </features>
Nov 08 14:14:31 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:14:31 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:14:31 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:14:31 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:14:31 user nova-compute[87365]:   </clock>
Nov 08 14:14:31 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:14:31 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:14:31 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:14:31 user nova-compute[87365]:   </cpu>
Nov 08 14:14:31 user nova-compute[87365]:   <devices>
Nov 08 14:14:31 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:14:31 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:14:31 user nova-compute[87365]:       <source dev="/dev/sdc"/>
Nov 08 14:14:31 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:14:31 user nova-compute[87365]:       <serial>6acaf64c-6038-419d-a4eb-c31f8cfefe3c</serial>
Nov 08 14:14:31 user nova-compute[87365]:     </disk>
Nov 08 14:14:31 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:14:31 user nova-compute[87365]:       <mac address="fa:16:3e:ca:aa:a1"/>
Nov 08 14:14:31 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:14:31 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:14:31 user nova-compute[87365]:       <target dev="tapa37f86ed-b8"/>
Nov 08 14:14:31 user nova-compute[87365]:     </interface>
Nov 08 14:14:31 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:14:31 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/68c5295b-1adc-4765-a07d-183ab13e2921/console.log" append="off"/>
Nov 08 14:14:31 user nova-compute[87365]:     </serial>
Nov 08 14:14:31 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:14:31 user nova-compute[87365]:     <video>
Nov 08 14:14:31 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:14:31 user nova-compute[87365]:     </video>
Nov 08 14:14:31 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:14:31 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:14:31 user nova-compute[87365]:     </rng>
Nov 08 14:14:31 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:14:31 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:14:31 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:14:31 user nova-compute[87365]:     </memballoon>
Nov 08 14:14:31 user nova-compute[87365]:   </devices>
Nov 08 14:14:31 user nova-compute[87365]: </domain>
Nov 08 14:14:31 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290377410',display_name='tempest-TestVolumeBootPattern-server-290377410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290377410',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-94er0ytz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:14:07Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=68c5295b-1adc-4765-a07d-183ab13e2921,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG os_vif [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd20b971-fe63-595e-9a15-7aaa2359f1b5', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa37f86ed-b8, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa37f86ed-b8, col_values=(('qos', UUID('a4412eea-1ed7-4a9e-8db1-3c064fa99dac')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa37f86ed-b8, col_values=(('external_ids', {'iface-id': 'a37f86ed-b801-419c-af71-fdfece84679b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:aa:a1', 'vm-uuid': '68c5295b-1adc-4765-a07d-183ab13e2921'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:31 user nova-compute[87365]: INFO os_vif [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8')
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] No VIF found with MAC fa:16:3e:ca:aa:a1, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:31 user nova-compute[87365]: INFO nova.compute.manager [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Terminating instance
Nov 08 14:14:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:14:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-unplugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] No waiting events found dispatching network-vif-unplugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-9f20644f-f6d5-4bb2-afb2-17681c975b1c req-6c065248-af48-4744-a03e-561d5f03ef15 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-unplugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] No waiting events found dispatching network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:32 user nova-compute[87365]: WARNING nova.compute.manager [req-6ba3fbf2-fe30-4edd-87b4-a9e073774ef8 req-2e62ad49-9e08-47fc-8433-4d135c47afad service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received unexpected event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b for instance with vm_state building and task_state spawning.
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Instance destroyed successfully.
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'resources' on Instance uuid 8449ebf2-af28-4fa2-8d18-5550729f9e93 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-895395451',display_name='tempest-AttachVolumeNegativeTest-server-895395451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-895395451',id=41,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCypJ2pRpmLk/NcTcN4BaIi1lf1/EKCNOyOpzr7c3pCCfYD/TOSSOG645dB3srRlPrqpNC7m6pWPGa8UGV3xvGq6qi1JRLIsGF+wn/jTDsKivFQj6SPR5Cp+GJNRFhhxVQ==',key_name='tempest-keypair-778207359',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-kfl6ao0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=8449ebf2-af28-4fa2-8d18-5550729f9e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "address": "fa:16:3e:39:47:c2", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e6cecff-e0", "ovs_interfaceid": "9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG os_vif [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e6cecff-e0, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54ba4707-c125-4f4d-b2a2-7164d6948883) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:14:33 user nova-compute[87365]: INFO os_vif [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:47:c2,bridge_name='br-int',has_traffic_filtering=True,id=9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e6cecff-e0')
Nov 08 14:14:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Deleting instance files /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93_del
Nov 08 14:14:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Deletion of /opt/stack/data/nova/instances/8449ebf2-af28-4fa2-8d18-5550729f9e93_del complete
Nov 08 14:14:33 user nova-compute[87365]: INFO nova.compute.manager [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 08 14:14:33 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:33 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Took 0.68 seconds to deallocate network for instance.
Nov 08 14:14:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:34 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Deleted allocations for instance 8449ebf2-af28-4fa2-8d18-5550729f9e93
Nov 08 14:14:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b1934f52-5c04-4a5b-b5bf-bd2410d6d011 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] Acquiring lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] Lock "8449ebf2-af28-4fa2-8d18-5550729f9e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] No waiting events found dispatching network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:34 user nova-compute[87365]: WARNING nova.compute.manager [req-ae52e37a-18c6-45f4-8b8f-d8ac37dac9cb req-309f4d01-5715-4f35-ad95-cc2a177befe6 service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received unexpected event network-vif-plugged-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab for instance with vm_state deleted and task_state None.
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:14:34 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Instance spawned successfully.
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:14:35 user nova-compute[87365]: INFO nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 08 14:14:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:14:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] No waiting events found dispatching network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:14:35 user nova-compute[87365]: WARNING nova.compute.manager [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received unexpected event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b for instance with vm_state building and task_state spawning.
Nov 08 14:14:35 user nova-compute[87365]: DEBUG nova.compute.manager [req-b917610c-080e-45a5-971e-73f409118ae8 req-dde42401-1677-4b71-a64a-caac56ca98ba service nova] [instance: 8449ebf2-af28-4fa2-8d18-5550729f9e93] Received event network-vif-deleted-9e6cecff-e0ca-4e53-9dcd-af7df92fc5ab {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:14:35 user nova-compute[87365]: INFO nova.compute.manager [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Took 28.43 seconds to build instance.
Nov 08 14:14:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-494fd6fd-cd8e-46a7-b0a4-597aaf29e8c2 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.524s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Going to confirm migration 2 {{(pid=87365) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'info_cache' on Instance uuid d2dec940-66be-4a6e-a3cb-3782788b3d36 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.network.neutron [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.objects.instance [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'migration_context' on Instance uuid d2dec940-66be-4a6e-a3cb-3782788b3d36 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.objects.base [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Object Instance<d2dec940-66be-4a6e-a3cb-3782788b3d36> lazy-loaded attributes: info_cache,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:38 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:14:39 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:14:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.302s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:39 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Deleted allocation for migration 0da8b45f-de05-483a-900a-a57e58671729
Nov 08 14:14:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-37ad94fc-7e57-4ba2-8f1a-ba44cd63d0f8 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.191s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:39 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:14:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:14:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:14:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=24.354045867919922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 68c5295b-1adc-4765-a07d-183ab13e2921 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:14:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:14:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:52 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:14:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:14:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:14:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:14:56 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [{"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-d2dec940-66be-4a6e-a3cb-3782788b3d36" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:14:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 3 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:14:57 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deletion of /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize failed
Nov 08 14:14:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:15:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:15:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:15:26 user nova-compute[87365]: INFO nova.compute.claims [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Claim successful on node user
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:15:26 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:15:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.policy [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f500e55fac46c59f38b0cd17172299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58ecaf473940859738817c8a91b64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:15:27 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Creating image(s)
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "/opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.168s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk 1073741824" returned: 0 in 0.052s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Successfully created port: 1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Cannot resize image /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Ensure instance console log exists: /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Successfully updated port: 1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquired lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-changed-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Refreshing instance network info cache due to event network-changed-1dec4ca8-51a6-413c-a86d-d3327b6bce68. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] Acquiring lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.neutron [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating instance_info_cache with network_info: [{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Releasing lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Instance network_info: |[{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] Acquired lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.neutron [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Refreshing network info cache for port 1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Start _get_guest_xml network_info=[{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:15:28 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:15:28 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1640320971',display_name='tempest-AttachVolumeNegativeTest-server-1640320971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1640320971',id=48,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEkm6oYqA4GpBorR4SdjNubeDOfA6WyMvQoEKkFCy0Ql3KJnFurZuF7Hp+56h6cS4D1B6FJxv/9LwkWVzHQyNCtFjai0TrVV7N93QIOrUSjVzoYfkvU1GIm3YlKhTV1sQ==',key_name='tempest-keypair-1846435488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-le3hmphr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=0816d898-082f-4193-aeff-82751a550202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.objects.instance [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'pci_devices' on Instance uuid 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:15:28 user nova-compute[87365]:   <uuid>0816d898-082f-4193-aeff-82751a550202</uuid>
Nov 08 14:15:28 user nova-compute[87365]:   <name>instance-00000030</name>
Nov 08 14:15:28 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:15:28 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:15:28 user nova-compute[87365]:   <metadata>
Nov 08 14:15:28 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:15:28 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1640320971</nova:name>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:15:28</nova:creationTime>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:15:28 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:15:28 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:owner>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:user uuid="25f500e55fac46c59f38b0cd17172299">tempest-AttachVolumeNegativeTest-1316129282-project-member</nova:user>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:project uuid="3e58ecaf473940859738817c8a91b64c">tempest-AttachVolumeNegativeTest-1316129282</nova:project>
Nov 08 14:15:28 user nova-compute[87365]:       </nova:owner>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:15:28 user nova-compute[87365]:       <nova:ports>
Nov 08 14:15:28 user nova-compute[87365]:         <nova:port uuid="1dec4ca8-51a6-413c-a86d-d3327b6bce68">
Nov 08 14:15:28 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 14:15:28 user nova-compute[87365]:         </nova:port>
Nov 08 14:15:28 user nova-compute[87365]:       </nova:ports>
Nov 08 14:15:28 user nova-compute[87365]:     </nova:instance>
Nov 08 14:15:28 user nova-compute[87365]:   </metadata>
Nov 08 14:15:28 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:15:28 user nova-compute[87365]:     <system>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="serial">0816d898-082f-4193-aeff-82751a550202</entry>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="uuid">0816d898-082f-4193-aeff-82751a550202</entry>
Nov 08 14:15:28 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:15:28 user nova-compute[87365]:     </system>
Nov 08 14:15:28 user nova-compute[87365]:   </sysinfo>
Nov 08 14:15:28 user nova-compute[87365]:   <os>
Nov 08 14:15:28 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:15:28 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:15:28 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:15:28 user nova-compute[87365]:   </os>
Nov 08 14:15:28 user nova-compute[87365]:   <features>
Nov 08 14:15:28 user nova-compute[87365]:     <acpi/>
Nov 08 14:15:28 user nova-compute[87365]:     <apic/>
Nov 08 14:15:28 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:15:28 user nova-compute[87365]:   </features>
Nov 08 14:15:28 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:15:28 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:15:28 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:15:28 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:15:28 user nova-compute[87365]:   </clock>
Nov 08 14:15:28 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:15:28 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:15:28 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:15:28 user nova-compute[87365]:   </cpu>
Nov 08 14:15:28 user nova-compute[87365]:   <devices>
Nov 08 14:15:28 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:15:28 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:15:28 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk"/>
Nov 08 14:15:28 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:15:28 user nova-compute[87365]:     </disk>
Nov 08 14:15:28 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:15:28 user nova-compute[87365]:       <mac address="fa:16:3e:ec:16:b7"/>
Nov 08 14:15:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:15:28 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:15:28 user nova-compute[87365]:       <target dev="tap1dec4ca8-51"/>
Nov 08 14:15:28 user nova-compute[87365]:     </interface>
Nov 08 14:15:28 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:15:28 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/console.log" append="off"/>
Nov 08 14:15:28 user nova-compute[87365]:     </serial>
Nov 08 14:15:28 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:15:28 user nova-compute[87365]:     <video>
Nov 08 14:15:28 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:15:28 user nova-compute[87365]:     </video>
Nov 08 14:15:28 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:15:28 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:15:28 user nova-compute[87365]:     </rng>
Nov 08 14:15:28 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:15:28 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:15:28 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:15:28 user nova-compute[87365]:     </memballoon>
Nov 08 14:15:28 user nova-compute[87365]:   </devices>
Nov 08 14:15:28 user nova-compute[87365]: </domain>
Nov 08 14:15:28 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1640320971',display_name='tempest-AttachVolumeNegativeTest-server-1640320971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1640320971',id=48,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEkm6oYqA4GpBorR4SdjNubeDOfA6WyMvQoEKkFCy0Ql3KJnFurZuF7Hp+56h6cS4D1B6FJxv/9LwkWVzHQyNCtFjai0TrVV7N93QIOrUSjVzoYfkvU1GIm3YlKhTV1sQ==',key_name='tempest-keypair-1846435488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-le3hmphr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=0816d898-082f-4193-aeff-82751a550202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG os_vif [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf0b8d92-7b7e-5909-bee0-4b5c14509d91', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dec4ca8-51, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dec4ca8-51, col_values=(('qos', UUID('66821d47-6c2b-467d-9c23-955995da3e76')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dec4ca8-51, col_values=(('external_ids', {'iface-id': '1dec4ca8-51a6-413c-a86d-d3327b6bce68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:16:b7', 'vm-uuid': '0816d898-082f-4193-aeff-82751a550202'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:28 user nova-compute[87365]: INFO os_vif [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51')
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:15:28 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:ec:16:b7, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:15:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Updated VIF entry in instance network info cache for port 1dec4ca8-51a6-413c-a86d-d3327b6bce68. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:15:29 user nova-compute[87365]: DEBUG nova.network.neutron [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating instance_info_cache with network_info: [{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:15:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b318a6fd-535c-4d2a-ad4b-bd16b82996b0 req-fe70d17e-4270-4838-98f0-83a63852ad6e service nova] Releasing lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] Acquiring lock "0816d898-082f-4193-aeff-82751a550202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] No waiting events found dispatching network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:15:30 user nova-compute[87365]: WARNING nova.compute.manager [req-b7ecdee4-60e6-4689-baeb-6a20547017e1 req-cfe931d9-27fb-428e-a7ee-86ded929e456 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received unexpected event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 for instance with vm_state building and task_state spawning.
Nov 08 14:15:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:15:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 0816d898-082f-4193-aeff-82751a550202] Instance spawned successfully.
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:15:32 user nova-compute[87365]: INFO nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] Acquiring lock "0816d898-082f-4193-aeff-82751a550202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] No waiting events found dispatching network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:15:32 user nova-compute[87365]: WARNING nova.compute.manager [req-ed90981f-01ce-4215-b391-62b5ff8a6c11 req-77b25002-9d58-448d-be5a-6ad901cea12d service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received unexpected event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 for instance with vm_state building and task_state spawning.
Nov 08 14:15:32 user nova-compute[87365]: INFO nova.compute.manager [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Took 5.85 seconds to build instance.
Nov 08 14:15:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-a4a151ff-cce7-449d-96eb-39d60f808bd4 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.954s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:41 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:15:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=24.324878692626953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 937e7773-8812-406a-87f3-48373678eeb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 68c5295b-1adc-4765-a07d-183ab13e2921 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0816d898-082f-4193-aeff-82751a550202 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:15:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:15:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-changed-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing instance network info cache due to event network-changed-a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] Acquiring lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] Acquired lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG nova.network.neutron [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing network info cache for port a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:15:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updated VIF entry in instance network info cache for port a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating instance_info_cache with network_info: [{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:59 user nova-compute[87365]: INFO nova.compute.manager [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Terminating instance
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2e8f0002-7ea8-45df-940f-54db212f94da req-cec40224-373c-4541-bfa8-43ce8f210959 service nova] Releasing lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-unplugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] No waiting events found dispatching network-vif-unplugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-92bbe97c-bd9b-4085-a0cc-2519d3d6ad9e req-c2b9e660-24ba-4ecd-962f-508890e37bbd service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-unplugged-a37f86ed-b801-419c-af71-fdfece84679b for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Instance destroyed successfully.
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid 68c5295b-1adc-4765-a07d-183ab13e2921 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-290377410',display_name='tempest-TestVolumeBootPattern-server-290377410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-290377410',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:14:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-94er0ytz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:14:35Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=68c5295b-1adc-4765-a07d-183ab13e2921,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_vif [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa37f86ed-b8, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4412eea-1ed7-4a9e-8db1-3c064fa99dac) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:15:59 user nova-compute[87365]: INFO os_vif [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:aa:a1,bridge_name='br-int',has_traffic_filtering=True,id=a37f86ed-b801-419c-af71-fdfece84679b,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37f86ed-b8')
Nov 08 14:15:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LryZjaIw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:15:59 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e854f2a-fdd2-4b19-8509-b8ff9dd586cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:15:59 user nova-compute[87365]: No targets found.
Nov 08 14:15:59 user nova-compute[87365]: iSNS:
Nov 08 14:15:59 user nova-compute[87365]: No targets found.
Nov 08 14:15:59 user nova-compute[87365]: STATIC:
Nov 08 14:15:59 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c
Nov 08 14:15:59 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:15:59 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:15:59 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:15:59 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:15:59 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:15:59 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:15:59 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:15:59 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:15:59 user nova-compute[87365]: FIRMWARE:
Nov 08 14:15:59 user nova-compute[87365]: No targets found.
Nov 08 14:15:59 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:15:59 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:15:59 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:15:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d6b85-4cad-4b6b-a25d-9e90f29ff27f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[72597bb1-63c3-491c-80b7-c60766da0abf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:16:00 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:16:00 user nova-compute[87365]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)
Nov 08 14:16:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:16:00 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:16:00 user nova-compute[87365]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c (non-flash)
Nov 08 14:16:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf84c20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a39280-b036-4a4a-b87f-d711eca7248c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[994dad8f-3441-485f-81dc-7d066dfb85c3]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f43bfc-6744-444f-964d-0e5e20ac5bc4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbaacab-7528-4f62-b946-1fb222ac3dd6]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8024416a-a9d9-46a6-bd25-e0aaf487fe28]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-changed-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.compute.manager [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing instance network info cache due to event network-changed-a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] Acquiring lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] Acquired lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Refreshing network info cache for port a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d03191-1d6a-4425-8955-85e4767479ca]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260]
Nov 08 14:16:00 user nova-compute[87365]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c, portal: 172.16.0.220,3260] successful.
Nov 08 14:16:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acaf64c-6038-419d-a4eb-c31f8cfefe3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[234ace3e-df10-4849-b364-16f4ff857f4d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (321ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:16:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Deleting instance files /opt/stack/data/nova/instances/68c5295b-1adc-4765-a07d-183ab13e2921_del
Nov 08 14:16:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Deletion of /opt/stack/data/nova/instances/68c5295b-1adc-4765-a07d-183ab13e2921_del complete
Nov 08 14:16:00 user nova-compute[87365]: INFO nova.compute.manager [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updated VIF entry in instance network info cache for port a37f86ed-b801-419c-af71-fdfece84679b. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.network.neutron [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating instance_info_cache with network_info: [{"id": "a37f86ed-b801-419c-af71-fdfece84679b", "address": "fa:16:3e:ca:aa:a1", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37f86ed-b8", "ovs_interfaceid": "a37f86ed-b801-419c-af71-fdfece84679b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-7bb74dfb-d280-408d-9081-26defa056d30 req-62d3fe58-b9c0-49c4-96af-0224a9deb17c service nova] Releasing lock "refresh_cache-68c5295b-1adc-4765-a07d-183ab13e2921" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:16:00 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:16:01 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Took 0.66 seconds to deallocate network for instance.
Nov 08 14:16:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] Acquiring lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] Lock "68c5295b-1adc-4765-a07d-183ab13e2921-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] No waiting events found dispatching network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:16:01 user nova-compute[87365]: WARNING nova.compute.manager [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received unexpected event network-vif-plugged-a37f86ed-b801-419c-af71-fdfece84679b for instance with vm_state active and task_state deleting.
Nov 08 14:16:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-f4b3bd3e-8562-4189-af46-9d9f35e50c3f req-eb4e47b6-50b5-47bf-a63f-bad1e744711c service nova] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Received event network-vif-deleted-a37f86ed-b801-419c-af71-fdfece84679b {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:01 user nova-compute[87365]: INFO nova.compute.manager [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 68c5295b-1adc-4765-a07d-183ab13e2921] Took 0.95 seconds to detach 1 volumes for instance.
Nov 08 14:16:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:02 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:16:02 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:16:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:02 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance 68c5295b-1adc-4765-a07d-183ab13e2921
Nov 08 14:16:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4b1fe58f-bb46-4f04-a497-ed75d7aae7a0 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "68c5295b-1adc-4765-a07d-183ab13e2921" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.273s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:14 user nova-compute[87365]: INFO nova.compute.manager [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Terminating instance
Nov 08 14:16:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG nova.compute.manager [req-80dae4b9-996c-459c-979d-a7bc583a6319 req-19d364db-b806-4ed3-8d45-b37e81349c77 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-unplugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Instance destroyed successfully.
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.objects.instance [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'resources' on Instance uuid 937e7773-8812-406a-87f3-48373678eeb1 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1435204684',display_name='tempest-AttachVolumeTestJSON-server-1435204684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1435204684',id=40,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgG1Z/Zxc7T4hXLkhY4fx9HB3vDJAvgsWFQXgrl5qSqD3hR4h2uJDsic4TH2ZPDu8uW05PTzxke2iq6axvEcAp1d/JozDaHicEPSGHXqdOja2cprX+OkSrmJjVV7/X13Q==',key_name='tempest-keypair-2009060869',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-41zlmrxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=937e7773-8812-406a-87f3-48373678eeb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "37bcfa01-a258-4259-8c18-44119de8d394", "address": "fa:16:3e:65:e2:8a", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bcfa01-a2", "ovs_interfaceid": "37bcfa01-a258-4259-8c18-44119de8d394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG os_vif [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37bcfa01-a2, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7711664d-7e6c-4b03-9d69-cdd6a2239ee7) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:15 user nova-compute[87365]: INFO os_vif [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:e2:8a,bridge_name='br-int',has_traffic_filtering=True,id=37bcfa01-a258-4259-8c18-44119de8d394,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bcfa01-a2')
Nov 08 14:16:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Deleting instance files /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1_del
Nov 08 14:16:15 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Deletion of /opt/stack/data/nova/instances/937e7773-8812-406a-87f3-48373678eeb1_del complete
Nov 08 14:16:15 user nova-compute[87365]: INFO nova.compute.manager [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 14:16:15 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:16:15 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:16:15 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Took 0.86 seconds to deallocate network for instance.
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:16 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Deleted allocations for instance 937e7773-8812-406a-87f3-48373678eeb1
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-568bd41d-79c8-4d76-b753-0e72572e1cf7 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "937e7773-8812-406a-87f3-48373678eeb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] Acquiring lock "937e7773-8812-406a-87f3-48373678eeb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] Lock "937e7773-8812-406a-87f3-48373678eeb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] No waiting events found dispatching network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:16:16 user nova-compute[87365]: WARNING nova.compute.manager [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received unexpected event network-vif-plugged-37bcfa01-a258-4259-8c18-44119de8d394 for instance with vm_state deleted and task_state None.
Nov 08 14:16:16 user nova-compute[87365]: DEBUG nova.compute.manager [req-bb73fe79-b99e-4481-90ad-f3d42072615e req-e3f782ea-cb1b-4313-a9c0-3caa04d50072 service nova] [instance: 937e7773-8812-406a-87f3-48373678eeb1] Received event network-vif-deleted-37bcfa01-a258-4259-8c18-44119de8d394 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:16:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:29 user nova-compute[87365]: INFO nova.compute.manager [None req-1dd9e85b-2ad2-47be-ac4d-0e1c93022a21 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Get console output
Nov 08 14:16:29 user nova-compute[87365]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 14:16:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:16:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:43 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:16:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:16:50 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=24.350204467773438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0816d898-082f-4193-aeff-82751a550202 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:16:50 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:16:51 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:16:51 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:16:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:16:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:16:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:16:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:16:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:16:58 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:16:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [{"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:16:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b365675d-bf53-45ad-b7bb-4d89cf1935c4" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:16:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:17:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:17:08 user nova-compute[87365]: INFO nova.compute.claims [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Claim successful on node user
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:17:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.policy [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8951eb125524b84a913e2e66e857fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c632e7ef13f4b03b843ce2996ecd29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:17:08 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Creating image(s)
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "/opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "/opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "/opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:08 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk 1073741824" returned: 0 in 0.052s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Successfully created port: b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Cannot resize image /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Ensure instance console log exists: /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Successfully updated port: b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquired lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-changed-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.compute.manager [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Refreshing instance network info cache due to event network-changed-b00570c8-4b80-4a48-90ff-a0d9851f3ad8. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] Acquiring lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:17:09 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.neutron [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Releasing lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Instance network_info: |[{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] Acquired lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.neutron [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Refreshing network info cache for port b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Start _get_guest_xml network_info=[{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:17:10 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:17:10 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70532939',display_name='tempest-AttachVolumeTestJSON-server-70532939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70532939',id=49,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkZG7FRhNzPPRUqsq0sUawnAmW7oyrG3y5Zdx19CxL4qNaehVwsclDfDA2fzc5DOQdt2+Yc32cGusVNSEeo80CDQpn+2d7UbuY8OHIpR1qpLlifDUdMCYFrY/iyChpZeg==',key_name='tempest-keypair-1930524595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-u9b91xac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=b98acd51-548c-4ef9-b61d-10bc1a1a46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'pci_devices' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:17:10 user nova-compute[87365]:   <uuid>b98acd51-548c-4ef9-b61d-10bc1a1a46be</uuid>
Nov 08 14:17:10 user nova-compute[87365]:   <name>instance-00000031</name>
Nov 08 14:17:10 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:17:10 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:17:10 user nova-compute[87365]:   <metadata>
Nov 08 14:17:10 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:17:10 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeTestJSON-server-70532939</nova:name>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:17:10</nova:creationTime>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:17:10 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:17:10 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:owner>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:user uuid="c8951eb125524b84a913e2e66e857fbc">tempest-AttachVolumeTestJSON-1235364264-project-member</nova:user>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:project uuid="2c632e7ef13f4b03b843ce2996ecd29f">tempest-AttachVolumeTestJSON-1235364264</nova:project>
Nov 08 14:17:10 user nova-compute[87365]:       </nova:owner>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:17:10 user nova-compute[87365]:       <nova:ports>
Nov 08 14:17:10 user nova-compute[87365]:         <nova:port uuid="b00570c8-4b80-4a48-90ff-a0d9851f3ad8">
Nov 08 14:17:10 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 14:17:10 user nova-compute[87365]:         </nova:port>
Nov 08 14:17:10 user nova-compute[87365]:       </nova:ports>
Nov 08 14:17:10 user nova-compute[87365]:     </nova:instance>
Nov 08 14:17:10 user nova-compute[87365]:   </metadata>
Nov 08 14:17:10 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:17:10 user nova-compute[87365]:     <system>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="serial">b98acd51-548c-4ef9-b61d-10bc1a1a46be</entry>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="uuid">b98acd51-548c-4ef9-b61d-10bc1a1a46be</entry>
Nov 08 14:17:10 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:17:10 user nova-compute[87365]:     </system>
Nov 08 14:17:10 user nova-compute[87365]:   </sysinfo>
Nov 08 14:17:10 user nova-compute[87365]:   <os>
Nov 08 14:17:10 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:17:10 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:17:10 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:17:10 user nova-compute[87365]:   </os>
Nov 08 14:17:10 user nova-compute[87365]:   <features>
Nov 08 14:17:10 user nova-compute[87365]:     <acpi/>
Nov 08 14:17:10 user nova-compute[87365]:     <apic/>
Nov 08 14:17:10 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:17:10 user nova-compute[87365]:   </features>
Nov 08 14:17:10 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:17:10 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:17:10 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:17:10 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:17:10 user nova-compute[87365]:   </clock>
Nov 08 14:17:10 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:17:10 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:17:10 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:17:10 user nova-compute[87365]:   </cpu>
Nov 08 14:17:10 user nova-compute[87365]:   <devices>
Nov 08 14:17:10 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:17:10 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:17:10 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk"/>
Nov 08 14:17:10 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:17:10 user nova-compute[87365]:     </disk>
Nov 08 14:17:10 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:17:10 user nova-compute[87365]:       <mac address="fa:16:3e:4e:8c:b0"/>
Nov 08 14:17:10 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:17:10 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:17:10 user nova-compute[87365]:       <target dev="tapb00570c8-4b"/>
Nov 08 14:17:10 user nova-compute[87365]:     </interface>
Nov 08 14:17:10 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:17:10 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/console.log" append="off"/>
Nov 08 14:17:10 user nova-compute[87365]:     </serial>
Nov 08 14:17:10 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:17:10 user nova-compute[87365]:     <video>
Nov 08 14:17:10 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:17:10 user nova-compute[87365]:     </video>
Nov 08 14:17:10 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:17:10 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:17:10 user nova-compute[87365]:     </rng>
Nov 08 14:17:10 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:17:10 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:17:10 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:17:10 user nova-compute[87365]:     </memballoon>
Nov 08 14:17:10 user nova-compute[87365]:   </devices>
Nov 08 14:17:10 user nova-compute[87365]: </domain>
Nov 08 14:17:10 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70532939',display_name='tempest-AttachVolumeTestJSON-server-70532939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70532939',id=49,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkZG7FRhNzPPRUqsq0sUawnAmW7oyrG3y5Zdx19CxL4qNaehVwsclDfDA2fzc5DOQdt2+Yc32cGusVNSEeo80CDQpn+2d7UbuY8OHIpR1qpLlifDUdMCYFrY/iyChpZeg==',key_name='tempest-keypair-1930524595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-u9b91xac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=b98acd51-548c-4ef9-b61d-10bc1a1a46be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG os_vif [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad92de19-5a29-5f51-9123-fa8ac14c8617', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00570c8-4b, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb00570c8-4b, col_values=(('qos', UUID('c0141c5b-5d5f-4db1-aad4-23feef376e5f')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb00570c8-4b, col_values=(('external_ids', {'iface-id': 'b00570c8-4b80-4a48-90ff-a0d9851f3ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:8c:b0', 'vm-uuid': 'b98acd51-548c-4ef9-b61d-10bc1a1a46be'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:10 user nova-compute[87365]: INFO os_vif [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b')
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No VIF found with MAC fa:16:3e:4e:8c:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.neutron [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updated VIF entry in instance network info cache for port b00570c8-4b80-4a48-90ff-a0d9851f3ad8. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG nova.network.neutron [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-73998112-62ca-482c-a9a4-b657a4a6a8f4 req-07e3a392-9f60-4b66-b85a-caaa2a351795 service nova] Releasing lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:11 user nova-compute[87365]: DEBUG nova.compute.manager [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] No waiting events found dispatching network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:11 user nova-compute[87365]: WARNING nova.compute.manager [req-e7f2683e-e2eb-4049-bbb2-8b3bf07842b9 req-e19ddeb4-bfed-47c8-a3e8-007754eede74 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received unexpected event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 for instance with vm_state building and task_state spawning.
Nov 08 14:17:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG nova.compute.manager [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing instance network info cache due to event network-changed-2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] Acquiring lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] Acquired lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG nova.network.neutron [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Refreshing network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:12 user nova-compute[87365]: INFO nova.compute.manager [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Terminating instance
Nov 08 14:17:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Instance destroyed successfully.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lazy-loading 'resources' on Instance uuid 3af78b19-8223-46fc-b8d4-a91a927cf8ee {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-408194928',display_name='tempest-TestVolumeBootPattern-server-408194928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-408194928',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfG6nNXhCxDXr+YLzgEPqSyKuP4nD3t1QeR2tJbvqlq/Qtzob/Vg1MRZ+T5iVwYzSmaaa6fMvlz7hph33k+zh9ftifsgxhDP++kX+Wcxa8+Na90GdZyK86/h0B5PaFJEA==',key_name='tempest-TestVolumeBootPattern-1713747327',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72686a705c7447abb29d45ccec5a3c1f',ramdisk_id='',reservation_id='r-53u07dm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-596681261',owner_user_name='tempest-TestVolumeBootPattern-596681261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:12:25Z,user_data=None,user_id='a19773693ca345709379304f9e6f0772',uuid=3af78b19-8223-46fc-b8d4-a91a927cf8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converting VIF {"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_vif [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updated VIF entry in instance network info cache for port 2ed96871-3c89-4d9d-9643-1d5c843f6f74. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [{"id": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "address": "fa:16:3e:b3:26:41", "network": {"id": "0d870171-f616-40dc-9c21-2acaf0cc6521", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-461255719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72686a705c7447abb29d45ccec5a3c1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed96871-3c", "ovs_interfaceid": "2ed96871-3c89-4d9d-9643-1d5c843f6f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ed96871-3c, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd418366-50fd-47f8-bedc-3b6476cf0568) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa344e54-7f70-4d58-a875-876f0c771154 req-68504d91-8648-416e-9591-2f7c83441fe3 service nova] Releasing lock "refresh_cache-3af78b19-8223-46fc-b8d4-a91a927cf8ee" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:17:13 user nova-compute[87365]: INFO os_vif [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:26:41,bridge_name='br-int',has_traffic_filtering=True,id=2ed96871-3c89-4d9d-9643-1d5c843f6f74,network=Network(0d870171-f616-40dc-9c21-2acaf0cc6521),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed96871-3c')
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMBjURLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:17:13 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[22459b41-32b0-4f4a-bce9-0f14c6924a28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:17:13 user nova-compute[87365]: No targets found.
Nov 08 14:17:13 user nova-compute[87365]: iSNS:
Nov 08 14:17:13 user nova-compute[87365]: No targets found.
Nov 08 14:17:13 user nova-compute[87365]: STATIC:
Nov 08 14:17:13 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:17:13 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:17:13 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:17:13 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64
Nov 08 14:17:13 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:17:13 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:17:13 user nova-compute[87365]: FIRMWARE:
Nov 08 14:17:13 user nova-compute[87365]: No targets found.
Nov 08 14:17:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:17:13 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:17:13 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf425f7-d196-4205-88c2-2a2bb9cdb42d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dba23b-1637-4027-9f74-d9b84367b6b6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:17:13 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:17:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 (non-flash)
Nov 08 14:17:13 user nova-compute[87365]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:17:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf830cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64'): ({'sdf'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Removing single pathed devices sdf {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e647e48-76d9-46fc-a81a-ea0e945afd30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d4e98c-e085-4f24-a4ec-3d696160f6d0]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Flushing IO for device /dev/sdf {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[040f50df-d591-467f-8c7e-87e93d3058d3]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e49b84-5845-4553-b7db-96f6314d97e1]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] SCSI volumes sdf have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb6f0f5-10bb-4fbf-8cd8-49774dd8d57f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[20477836-bbee-44ba-963c-82f097d75df0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260]
Nov 08 14:17:13 user nova-compute[87365]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64, portal: 172.16.0.220,3260] successful.
Nov 08 14:17:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d90fff52-7c64-4e39-9bf3-2c77bef47d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe2ae5-109a-4b84-9feb-ec9c6a1c8e45]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] <== disconnect_volume: return (293ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Deleting instance files /opt/stack/data/nova/instances/3af78b19-8223-46fc-b8d4-a91a927cf8ee_del
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Deletion of /opt/stack/data/nova/instances/3af78b19-8223-46fc-b8d4-a91a927cf8ee_del complete
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.compute.manager [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Instance spawned successfully.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Took 0.41 seconds to deallocate network for instance.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] No waiting events found dispatching network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:13 user nova-compute[87365]: WARNING nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received unexpected event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 for instance with vm_state building and task_state spawning.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-unplugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] No waiting events found dispatching network-vif-unplugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-unplugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Acquiring lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] No waiting events found dispatching network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:13 user nova-compute[87365]: WARNING nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received unexpected event network-vif-plugged-2ed96871-3c89-4d9d-9643-1d5c843f6f74 for instance with vm_state active and task_state deleting.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Received event network-vif-deleted-2ed96871-3c89-4d9d-9643-1d5c843f6f74 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Neutron deleted interface 2ed96871-3c89-4d9d-9643-1d5c843f6f74; detaching it from the instance and deleting it from the info cache
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.network.neutron [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [req-e26cbadc-2958-45f8-b8c0-7b934991a285 req-dafb0501-7c76-46c1-adba-5eb415c5b4a6 service nova] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Detach interface failed, port_id=2ed96871-3c89-4d9d-9643-1d5c843f6f74, reason: Instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:17:13 user nova-compute[87365]: INFO nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 08 14:17:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:17:14 user nova-compute[87365]: INFO nova.compute.manager [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Took 6.07 seconds to build instance.
Nov 08 14:17:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4bddcb0e-c770-4e1f-812a-a5e9a58aee01 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.267s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:14 user nova-compute[87365]: INFO nova.compute.manager [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] [instance: 3af78b19-8223-46fc-b8d4-a91a927cf8ee] Took 0.97 seconds to detach 1 volumes for instance.
Nov 08 14:17:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:15 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:17:15 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:17:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:15 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Deleted allocations for instance 3af78b19-8223-46fc-b8d4-a91a927cf8ee
Nov 08 14:17:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4e2371a5-2f29-48bf-82f5-4c5b3a1f63b4 tempest-TestVolumeBootPattern-596681261 tempest-TestVolumeBootPattern-596681261-project-member] Lock "3af78b19-8223-46fc-b8d4-a91a927cf8ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.053s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-changed-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Refreshing instance network info cache due to event network-changed-1dec4ca8-51a6-413c-a86d-d3327b6bce68. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] Acquiring lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] Acquired lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:17:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Refreshing network info cache for port 1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:17:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Updated VIF entry in instance network info cache for port 1dec4ca8-51a6-413c-a86d-d3327b6bce68. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:17:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating instance_info_cache with network_info: [{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb494e11-3826-4a76-8865-e806a821c429 req-7aeadc16-0940-4b48-99d0-c3f909a9f320 service nova] Releasing lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:17:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:23 user nova-compute[87365]: INFO nova.compute.manager [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Attaching volume d51b6b05-ef0a-46d0-9c53-65be9306b0ef to /dev/vdb
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.utils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d90c2-e548-4b05-a566-7caa189f6b5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f0856-1b57-41fa-931b-7d739ce6dd0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[db156d8c-a305-4e09-9ba8-16b9b4feccc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a9ce5-9827-4228-ba9a-df3c7de3e708]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:17:23 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:17:23 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b152d-8673-4eaa-8c17-dad3d2df7292]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG os_brick.utils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:17:23 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating existing volume attachment record: 602d0d4b-a873-4d14-ad0c-9c23a7a23eb5 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:17:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:29 user nova-compute[87365]: INFO nova.compute.manager [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Terminating instance
Nov 08 14:17:29 user nova-compute[87365]: DEBUG nova.compute.manager [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-1c6b4180-72f6-40e7-b618-4b7fba2bce58 req-a36ce00d-2ce4-4d47-a317-9e1063bfeed2 service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-unplugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:17:30 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Instance destroyed successfully.
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.objects.instance [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'resources' on Instance uuid d2dec940-66be-4a6e-a3cb-3782788b3d36 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-721364548',display_name='tempest-ServerActionsTestOtherA-server-721364548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-721364548',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-4ebj6aed',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=d2dec940-66be-4a6e-a3cb-3782788b3d36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "c3645578-72ef-4aad-905a-f1dbb769299d", "address": "fa:16:3e:b1:da:02", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3645578-72", "ovs_interfaceid": "c3645578-72ef-4aad-905a-f1dbb769299d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_vif [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3645578-72, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e787b3b-abed-4652-8f07-9921606d1188) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:17:30 user nova-compute[87365]: INFO os_vif [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:da:02,bridge_name='br-int',has_traffic_filtering=True,id=c3645578-72ef-4aad-905a-f1dbb769299d,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3645578-72')
Nov 08 14:17:30 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHWNyusb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:17:30 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c2612-b62e-4ac6-8434-e70151539998]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:17:30 user nova-compute[87365]: No targets found.
Nov 08 14:17:30 user nova-compute[87365]: iSNS:
Nov 08 14:17:30 user nova-compute[87365]: No targets found.
Nov 08 14:17:30 user nova-compute[87365]: STATIC:
Nov 08 14:17:30 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e
Nov 08 14:17:30 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:17:30 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:17:30 user nova-compute[87365]: FIRMWARE:
Nov 08 14:17:30 user nova-compute[87365]: No targets found.
Nov 08 14:17:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:17:30 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:17:30 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec07fc98-106d-40b8-a35f-0efa8dd0e9eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd32543a-2904-4212-974e-c4ea34352162]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:17:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e (non-flash)
Nov 08 14:17:30 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf830cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[196e8481-a756-4e6e-839e-9fab0e9110e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d94d6-f2bb-47c8-9bbf-1e629e3147f6]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d532c-48cf-4c16-b481-935fcacfe19a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[076d1941-9bd5-4705-9786-fe0972f40c65]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObfe1e0ca-770ad60e6a433468', '/dev/disk/by-id/scsi-23737306164363065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bfe1e0ca') {{(pid=99274) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[857a13d3-15f7-467f-a3ab-10dc11e6c4d0]: (4, None) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a13ead-273d-4582-91e3-ebd787afbd14]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:30 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5db575-1945-4c35-b8f8-a44300f053e8]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260]
Nov 08 14:17:31 user nova-compute[87365]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e, portal: 172.16.0.220,3260] successful.
Nov 08 14:17:31 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d67d33-8bac-450a-a31e-515552b0351e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc79c30-8dc3-4ede-82f1-6f19165f83e5]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] <== disconnect_volume: return (308ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:17:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Deleting instance files /opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36_del
Nov 08 14:17:31 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Deletion of /opt/stack/data/nova/instances/d2dec940-66be-4a6e-a3cb-3782788b3d36_del complete
Nov 08 14:17:31 user nova-compute[87365]: INFO nova.compute.manager [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 14:17:31 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-1506c255-9d79-49b7-b949-ee8514a36308 req-5ab16708-cd0e-4bf2-af69-10b597a319af service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-deleted-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:31 user nova-compute[87365]: INFO nova.compute.manager [req-1506c255-9d79-49b7-b949-ee8514a36308 req-5ab16708-cd0e-4bf2-af69-10b597a319af service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Neutron deleted interface c3645578-72ef-4aad-905a-f1dbb769299d; detaching it from the instance and deleting it from the info cache
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.network.neutron [req-1506c255-9d79-49b7-b949-ee8514a36308 req-5ab16708-cd0e-4bf2-af69-10b597a319af service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:17:31 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Took 0.87 seconds to deallocate network for instance.
Nov 08 14:17:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-1506c255-9d79-49b7-b949-ee8514a36308 req-5ab16708-cd0e-4bf2-af69-10b597a319af service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Detach interface failed, port_id=c3645578-72ef-4aad-905a-f1dbb769299d, reason: Instance d2dec940-66be-4a6e-a3cb-3782788b3d36 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] Acquiring lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] No waiting events found dispatching network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:17:32 user nova-compute[87365]: WARNING nova.compute.manager [req-1b90c04c-155f-4832-930f-4489b02daa15 req-8726a369-b85f-4c67-9069-dafd12f993cf service nova] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Received unexpected event network-vif-plugged-c3645578-72ef-4aad-905a-f1dbb769299d for instance with vm_state active and task_state deleting.
Nov 08 14:17:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:32 user nova-compute[87365]: INFO nova.compute.manager [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Took 0.87 seconds to detach 1 volumes for instance.
Nov 08 14:17:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: d2dec940-66be-4a6e-a3cb-3782788b3d36] Deleting volume: 03d67d33-8bac-450a-a31e-515552b0351e {{(pid=87365) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:33 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:17:33 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:17:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:33 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Deleted allocations for instance d2dec940-66be-4a6e-a3cb-3782788b3d36
Nov 08 14:17:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-60ff4a7b-a76e-4e13-afb6-4ee2ba7140f5 tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "d2dec940-66be-4a6e-a3cb-3782788b3d36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.438s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:45 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haFAEVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:17:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:17:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:17:46 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f4d9a6-ff2c-4922-9a1d-f4a6aad2d2f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:17:46 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d41931-d0f4-496c-ba4e-7819980439a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef] added
Nov 08 14:17:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc4d39b-3730-4d4d-a466-33cd67c4dcf4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[193702f3-d433-41d6-83c7-f2762957e42c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haFAEVwm {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v haFAEVwm" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2dc9b-49df-43b9-aa79-536386d996bb]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'haFAEVwm'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e6762-4cf6-4aca-b110-088c24318b72]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e96b4-fe60-4f7d-9385-dbc7d113d213]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:17:46 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:17:46 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:17:46 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:17:46 user nova-compute[87365]: 
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb35fc2-336a-4a3e-9ed2-733620340118]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260]
Nov 08 14:17:46 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260] successful.
Nov 08 14:17:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbecd8-fb19-4ff4-931a-0e3b956c6a54]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[815307d2-3d5f-4b4e-b551-f456d369d50c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)
Nov 08 14:17:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)
Nov 08 14:17:46 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f32fd2-769d-484f-818c-b0cd1f7615f9]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:17:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haFAEVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23737616338613738', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737616338613738', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:17:47 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:17:47 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:17:47 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:17:47 user nova-compute[87365]:   <serial>d51b6b05-ef0a-46d0-9c53-65be9306b0ef</serial>
Nov 08 14:17:47 user nova-compute[87365]: </disk>
Nov 08 14:17:47 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:ec:16:b7, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:17:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-910f11c4-5a56-476c-9de1-c36099824432 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.215s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:48 user nova-compute[87365]: INFO nova.compute.manager [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Detaching volume d51b6b05-ef0a-46d0-9c53-65be9306b0ef
Nov 08 14:17:48 user nova-compute[87365]: INFO nova.virt.block_device [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Attempting to driver detach volume d51b6b05-ef0a-46d0-9c53-65be9306b0ef from mountpoint /dev/vdb
Nov 08 14:17:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Attempting to detach device vdb from instance 0816d898-082f-4193-aeff-82751a550202 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:17:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:17:48 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:17:48 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:17:48 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:17:48 user nova-compute[87365]:   <serial>d51b6b05-ef0a-46d0-9c53-65be9306b0ef</serial>
Nov 08 14:17:48 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:17:48 user nova-compute[87365]: </disk>
Nov 08 14:17:48 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:17:48 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance 0816d898-082f-4193-aeff-82751a550202 from the persistent domain config.
Nov 08 14:17:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0816d898-082f-4193-aeff-82751a550202 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:17:48 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:17:48 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:17:48 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:17:48 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:17:48 user nova-compute[87365]:   <serial>d51b6b05-ef0a-46d0-9c53-65be9306b0ef</serial>
Nov 08 14:17:48 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:17:48 user nova-compute[87365]: </disk>
Nov 08 14:17:48 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:17:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:17:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:17:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:17:53 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:17:53 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=24.319190979003906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b365675d-bf53-45ad-b7bb-4d89cf1935c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 0816d898-082f-4193-aeff-82751a550202 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b98acd51-548c-4ef9-b61d-10bc1a1a46be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:17:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:17:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:17:55 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:17:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:17:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:18:00 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 0816d898-082f-4193-aeff-82751a550202] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:18:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating instance_info_cache with network_info: [{"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:18:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-0816d898-082f-4193-aeff-82751a550202" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:18:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 0816d898-082f-4193-aeff-82751a550202] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:18:03 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:09 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0816d898-082f-4193-aeff-82751a550202 is timed out.
Nov 08 14:18:09 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance 0816d898-082f-4193-aeff-82751a550202 from the live domain config.
Nov 08 14:18:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'haFAEVwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:18:09 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0957db-8e87-4b27-8806-271091537b80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:18:09 user nova-compute[87365]: No targets found.
Nov 08 14:18:09 user nova-compute[87365]: iSNS:
Nov 08 14:18:09 user nova-compute[87365]: No targets found.
Nov 08 14:18:09 user nova-compute[87365]: STATIC:
Nov 08 14:18:09 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef
Nov 08 14:18:09 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:18:09 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:18:09 user nova-compute[87365]: FIRMWARE:
Nov 08 14:18:09 user nova-compute[87365]: No targets found.
Nov 08 14:18:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:18:09 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:18:09 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[875fc0ed-4f76-44c6-bbb1-2e366cfa3a3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[46923a1e-6925-4810-a6ce-be5dd04d6245]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)
Nov 08 14:18:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef (non-flash)
Nov 08 14:18:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d18295e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2095f62-9394-4184-8812-915d57dfab4b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19030c09-306a-48ec-b418-25af12659f15]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[386dd537-0046-46bd-bd1a-72dc23dc4d0f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d999df-e13b-43e8-97e6-c9bba8efae10]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c836ce8-6a20-40cf-a757-98995541ac98]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd92ecd-c2e0-4df4-b61d-844fa7d2d762]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260]
Nov 08 14:18:09 user nova-compute[87365]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef, portal: 172.16.0.220,3260] successful.
Nov 08 14:18:09 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51b6b05-ef0a-46d0-9c53-65be9306b0ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea22b3f-a97d-4bda-80e9-bc8a719b4aaf]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== disconnect_volume: return (277ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:18:09 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:18:10 user nova-compute[87365]: DEBUG nova.objects.instance [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:18:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-de2f955b-60b6-4456-bd80-d802f690032d tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:31 user nova-compute[87365]: INFO nova.compute.manager [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Terminating instance
Nov 08 14:18:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-unplugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] No waiting events found dispatching network-vif-unplugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:18:31 user nova-compute[87365]: DEBUG nova.compute.manager [req-80c2094b-ae0d-483f-8ee5-6ba01f69d57c req-24ca2368-3684-4036-b6b5-f21e5913f36a service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-unplugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:18:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Instance destroyed successfully.
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lazy-loading 'resources' on Instance uuid b365675d-bf53-45ad-b7bb-4d89cf1935c4 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:43:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1424015704',display_name='tempest-ServerActionsTestOtherA-server-1424015704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1424015704',id=6,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiymo6tE0eCpb207NMtQAAwmLP5zrY8OYq8NlXwmQRMsHuWqr9zpU2hCN2ENvtWMIZLR+CtqBlhKGXv7jbnoY7j6GQf4YZTg7cHpyijVn89NNMUWOMmo2X2jpU88fZGvw==',key_name='tempest-keypair-1943059873',keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90a890ce53c34008a7a872f409fe4550',ramdisk_id='',reservation_id='r-rp1ronly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-777028083',owner_user_name='tempest-ServerActionsTestOtherA-777028083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33521b67405a405f912d0879b3d77829',uuid=b365675d-bf53-45ad-b7bb-4d89cf1935c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converting VIF {"id": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "address": "fa:16:3e:4b:b1:04", "network": {"id": "30695e36-79ef-48d7-9741-3c6abe189f9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2144194722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90a890ce53c34008a7a872f409fe4550", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd8195-16", "ovs_interfaceid": "f9bd8195-16dc-48da-b0f6-c9980a7ebcaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG os_vif [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9bd8195-16, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72eeb949-07b2-481f-a69a-a42254b8ad01) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:32 user nova-compute[87365]: INFO os_vif [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b1:04,bridge_name='br-int',has_traffic_filtering=True,id=f9bd8195-16dc-48da-b0f6-c9980a7ebcaa,network=Network(30695e36-79ef-48d7-9741-3c6abe189f9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd8195-16')
Nov 08 14:18:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Deleting instance files /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4_del
Nov 08 14:18:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Deletion of /opt/stack/data/nova/instances/b365675d-bf53-45ad-b7bb-4d89cf1935c4_del complete
Nov 08 14:18:32 user nova-compute[87365]: INFO nova.compute.manager [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 14:18:32 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:18:32 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Took 0.59 seconds to deallocate network for instance.
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-02553bbe-938d-49ef-be8b-01327aa6c68f req-85d94738-1a7c-4f6c-bdcb-7f07e22c4a61 service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-deleted-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:18:32 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:33 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Deleted allocations for instance b365675d-bf53-45ad-b7bb-4d89cf1935c4
Nov 08 14:18:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d83b803d-0e28-4e25-8605-9a9e2cf8944f tempest-ServerActionsTestOtherA-777028083 tempest-ServerActionsTestOtherA-777028083-project-member] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] Acquiring lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] Lock "b365675d-bf53-45ad-b7bb-4d89cf1935c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:33 user nova-compute[87365]: DEBUG nova.compute.manager [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] No waiting events found dispatching network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:18:33 user nova-compute[87365]: WARNING nova.compute.manager [req-5bd3f2bf-6ce4-4d17-a707-ef737d0f209d req-2a1eca7d-69fb-4366-a668-740d9e914e4d service nova] [instance: b365675d-bf53-45ad-b7bb-4d89cf1935c4] Received unexpected event network-vif-plugged-f9bd8195-16dc-48da-b0f6-c9980a7ebcaa for instance with vm_state deleted and task_state None.
Nov 08 14:18:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "0816d898-082f-4193-aeff-82751a550202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:39 user nova-compute[87365]: INFO nova.compute.manager [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Terminating instance
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.compute.manager [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-unplugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] Acquiring lock "0816d898-082f-4193-aeff-82751a550202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] No waiting events found dispatching network-vif-unplugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.compute.manager [req-aa45fd8c-710a-40ac-b9bf-d0f9c649172a req-3ea0b6ee-7616-4d60-9d98-ea2a6c70cb90 service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-unplugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:18:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 0816d898-082f-4193-aeff-82751a550202] Instance destroyed successfully.
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.objects.instance [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'resources' on Instance uuid 0816d898-082f-4193-aeff-82751a550202 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1640320971',display_name='tempest-AttachVolumeNegativeTest-server-1640320971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1640320971',id=48,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEkm6oYqA4GpBorR4SdjNubeDOfA6WyMvQoEKkFCy0Ql3KJnFurZuF7Hp+56h6cS4D1B6FJxv/9LwkWVzHQyNCtFjai0TrVV7N93QIOrUSjVzoYfkvU1GIm3YlKhTV1sQ==',key_name='tempest-keypair-1846435488',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:15:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-le3hmphr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=0816d898-082f-4193-aeff-82751a550202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "address": "fa:16:3e:ec:16:b7", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dec4ca8-51", "ovs_interfaceid": "1dec4ca8-51a6-413c-a86d-d3327b6bce68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG os_vif [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dec4ca8-51, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66821d47-6c2b-467d-9c23-955995da3e76) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:39 user nova-compute[87365]: INFO os_vif [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:16:b7,bridge_name='br-int',has_traffic_filtering=True,id=1dec4ca8-51a6-413c-a86d-d3327b6bce68,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dec4ca8-51')
Nov 08 14:18:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Deleting instance files /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202_del
Nov 08 14:18:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Deletion of /opt/stack/data/nova/instances/0816d898-082f-4193-aeff-82751a550202_del complete
Nov 08 14:18:39 user nova-compute[87365]: INFO nova.compute.manager [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: 0816d898-082f-4193-aeff-82751a550202] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 14:18:39 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 0816d898-082f-4193-aeff-82751a550202] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:18:39 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 0816d898-082f-4193-aeff-82751a550202] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:18:40 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 0816d898-082f-4193-aeff-82751a550202] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:18:40 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 0816d898-082f-4193-aeff-82751a550202] Took 0.89 seconds to deallocate network for instance.
Nov 08 14:18:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-1aea40d6-a590-43f5-acd3-151d5041570f req-6ff99f29-2b6d-42df-a1e4-a99aaf0978ef service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-deleted-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:41 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Deleted allocations for instance 0816d898-082f-4193-aeff-82751a550202
Nov 08 14:18:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-17284e8d-e734-4502-8cfc-3dcf237008a9 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "0816d898-082f-4193-aeff-82751a550202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] Acquiring lock "0816d898-082f-4193-aeff-82751a550202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] Lock "0816d898-082f-4193-aeff-82751a550202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:41 user nova-compute[87365]: DEBUG nova.compute.manager [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] No waiting events found dispatching network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:18:41 user nova-compute[87365]: WARNING nova.compute.manager [req-02da2896-b4e5-4730-971c-8537e8f1ab7d req-bfaf8d1c-23cd-426f-bb51-f8fc1a588f8a service nova] [instance: 0816d898-082f-4193-aeff-82751a550202] Received unexpected event network-vif-plugged-1dec4ca8-51a6-413c-a86d-d3327b6bce68 for instance with vm_state deleted and task_state None.
Nov 08 14:18:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:46 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:18:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:51 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:53 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:18:54 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:18:54 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=24.365394592285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b98acd51-548c-4ef9-b61d-10bc1a1a46be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:18:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:18:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-changed-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:18:58 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Refreshing instance network info cache due to event network-changed-b00570c8-4b80-4a48-90ff-a0d9851f3ad8. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:18:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] Acquiring lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:18:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] Acquired lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:18:58 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Refreshing network info cache for port b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updated VIF entry in instance network info cache for port b00570c8-4b80-4a48-90ff-a0d9851f3ad8. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6fe77c4-1bd1-4a6f-96fe-041af3bc7e38 req-b4198a4f-758c-433e-a52d-c9931ecb5358 service nova] Releasing lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:18:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:19:01 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:19:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:19:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:19:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:04 user nova-compute[87365]: INFO nova.compute.manager [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attaching volume c21e59ad-1cd1-48e9-8fda-de07261760c8 to /dev/vdb
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.utils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[080d435b-84b8-4fc9-a23a-5a8d23f21bec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79bda3-b95c-4c6b-8696-2ae448de2aa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[99961ce3-e135-4cbe-ac82-cc231bc66106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[35709d25-0bf8-486e-b06f-fd2eec775e0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:19:04 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:19:04 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dcc10e-bff4-4ef8-a91a-eb7ada8de0ec]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG os_brick.utils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:19:04 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating existing volume attachment record: 61ef886b-aac9-498a-a75a-d29b4b768c9d {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:19:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Verify base images {{(pid=87365) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Image id 46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd yields fingerprint cd02cc4d8b2514a894f94380a3eb552bc05647b3 {{(pid=87365) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] image 46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd at (/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3): checking
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] image 46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd at (/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3): image is in use {{(pid=87365) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=87365) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] b98acd51-548c-4ef9-b61d-10bc1a1a46be is a valid instance name {{(pid=87365) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] b98acd51-548c-4ef9-b61d-10bc1a1a46be has a disk file {{(pid=87365) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b98acd51-548c-4ef9-b61d-10bc1a1a46be is backed by cd02cc4d8b2514a894f94380a3eb552bc05647b3 {{(pid=87365) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7
Nov 08 14:19:16 user nova-compute[87365]: WARNING nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Unknown base file: /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Active base files: /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Removable base files: /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823 /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95 /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5 /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7 /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d27b4f4b0e66fccc788186b0bf26b482e9f3e823
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/397cd06e356683a7955164cdaf86a25503548c95
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c18fbfa53e2b68887176511dae94fa848e67d0f5
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfa14c1a4992c5d882b44f6ca078cea413ad7b3b
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73bfff7c5188f567c4093a0bc67a0ccec8658a5b
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d63052c51a8bc1a18351403938bcd9fbd20781e7
Nov 08 14:19:16 user nova-compute[87365]: INFO nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/660e8796b2d70c9a556e59fed2592087f46137e0
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Verification complete {{(pid=87365) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Verify swap images {{(pid=87365) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 14:19:16 user nova-compute[87365]: DEBUG nova.virt.libvirt.imagecache [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Verify ephemeral images {{(pid=87365) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 14:19:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSRaJIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:19:25 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:19:25 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:19:25 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7a020-dfb3-4cf4-a4ca-9f9f249edcc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:19:25 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b0af6-e435-4cf4-9bdc-f9b74771a0eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8] added
Nov 08 14:19:25 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:25 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fe01d-2c6f-4eab-8068-66544d83a754]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5c6be-028d-4566-aec1-5fc4fccbc8b4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSRaJIG {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jUSRaJIG" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b8b877-1b9c-459b-a1ad-0c3a3275f569]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jUSRaJIG'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224753d-3383-4de8-b835-1aca6e469fc0]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[57984119-1f97-4c60-9dc4-6c3f8f48b553]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:19:26 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:19:26 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:19:26 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:19:26 user nova-compute[87365]: 
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd689a-1026-4667-9e50-f07b4502ad07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260]
Nov 08 14:19:26 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260] successful.
Nov 08 14:19:26 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[19586dd8-1424-4ce0-8d9f-4e690ecd127c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d415a5-b092-4e9e-a79d-27768de5af94]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:26 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:26 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f60dc-1735-4ef6-9132-317d0ce98af5]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:19:26 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSRaJIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23935616433646537', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616433646537', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.objects.instance [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:19:27 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:19:27 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:19:27 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:19:27 user nova-compute[87365]:   <serial>c21e59ad-1cd1-48e9-8fda-de07261760c8</serial>
Nov 08 14:19:27 user nova-compute[87365]: </disk>
Nov 08 14:19:27 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No VIF found with MAC fa:16:3e:4e:8c:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:19:27 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-6994b937-b431-4e7b-b060-9bacbcc8340c tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.084s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:32 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:19:32 user nova-compute[87365]: INFO nova.compute.claims [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Claim successful on node user
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:19:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:19:33 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Creating image(s)
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "/opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.policy [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f500e55fac46c59f38b0cd17172299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e58ecaf473940859738817c8a91b64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.181s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.168s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3,backing_fmt=raw /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk 1073741824" returned: 0 in 0.061s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "cd02cc4d8b2514a894f94380a3eb552bc05647b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cd02cc4d8b2514a894f94380a3eb552bc05647b3 --force-share --output=json" returned: 0 in 0.174s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:19:33 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Successfully created port: 024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Cannot resize image /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Ensure instance console log exists: /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:34 user nova-compute[87365]: INFO nova.compute.manager [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attaching volume 3731c89b-f487-4f0b-b61b-1769adc3e442 to /dev/vdc
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[798c9d92-0603-4967-975e-2d4f07e87aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4bd124-fab4-456a-be7d-0602e1bf1373]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5d4475-2e38-4da2-a38d-f7dfad18a85d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd1e9ff-2837-447d-9a1e-a24bc7d5a3bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:19:34 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daad37a-b4f9-4f97-a833-67a56ade8a42]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG os_brick.utils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating existing volume attachment record: 1c722827-58e8-4513-82cf-2b34e0c6b03f {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Successfully updated port: 024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquired lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-changed-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG nova.compute.manager [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Refreshing instance network info cache due to event network-changed-024a96cb-c114-46dd-acc3-3b85f0a9020a. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] Acquiring lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:19:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.neutron [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Releasing lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Instance network_info: |[{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] Acquired lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Refreshing network info cache for port 024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Start _get_guest_xml network_info=[{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:19:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:19:35 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T13:39:45Z,direct_url=<?>,disk_format='qcow2',id=46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b624e3c01b514a55ad51e537a2f2f04d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T13:39:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-952065685',display_name='tempest-AttachVolumeNegativeTest-server-952065685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-952065685',id=50,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2yLKnIS21ogacrL4y5WKCWXFBvZZ/Na9G3rBQnRi30dnO2QmgRLTeU8VXcZPgQiVzt6nDm8Q3TAl3DhGAyB5d4CXyOmeqIMeSw0I4xTULnRT2VAuDwlRdnbd6ZbmHUlA==',key_name='tempest-keypair-1231198605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-25tikm9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=f4589e37-0407-4667-b3a9-26009f6bef15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.objects.instance [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'pci_devices' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:19:35 user nova-compute[87365]:   <uuid>f4589e37-0407-4667-b3a9-26009f6bef15</uuid>
Nov 08 14:19:35 user nova-compute[87365]:   <name>instance-00000032</name>
Nov 08 14:19:35 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:19:35 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:19:35 user nova-compute[87365]:   <metadata>
Nov 08 14:19:35 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:19:35 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:name>tempest-AttachVolumeNegativeTest-server-952065685</nova:name>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:19:35</nova:creationTime>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:19:35 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:19:35 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:owner>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:user uuid="25f500e55fac46c59f38b0cd17172299">tempest-AttachVolumeNegativeTest-1316129282-project-member</nova:user>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:project uuid="3e58ecaf473940859738817c8a91b64c">tempest-AttachVolumeNegativeTest-1316129282</nova:project>
Nov 08 14:19:35 user nova-compute[87365]:       </nova:owner>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:root type="image" uuid="46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd"/>
Nov 08 14:19:35 user nova-compute[87365]:       <nova:ports>
Nov 08 14:19:35 user nova-compute[87365]:         <nova:port uuid="024a96cb-c114-46dd-acc3-3b85f0a9020a">
Nov 08 14:19:35 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:19:35 user nova-compute[87365]:         </nova:port>
Nov 08 14:19:35 user nova-compute[87365]:       </nova:ports>
Nov 08 14:19:35 user nova-compute[87365]:     </nova:instance>
Nov 08 14:19:35 user nova-compute[87365]:   </metadata>
Nov 08 14:19:35 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:19:35 user nova-compute[87365]:     <system>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="serial">f4589e37-0407-4667-b3a9-26009f6bef15</entry>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="uuid">f4589e37-0407-4667-b3a9-26009f6bef15</entry>
Nov 08 14:19:35 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:19:35 user nova-compute[87365]:     </system>
Nov 08 14:19:35 user nova-compute[87365]:   </sysinfo>
Nov 08 14:19:35 user nova-compute[87365]:   <os>
Nov 08 14:19:35 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:19:35 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:19:35 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:19:35 user nova-compute[87365]:   </os>
Nov 08 14:19:35 user nova-compute[87365]:   <features>
Nov 08 14:19:35 user nova-compute[87365]:     <acpi/>
Nov 08 14:19:35 user nova-compute[87365]:     <apic/>
Nov 08 14:19:35 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:19:35 user nova-compute[87365]:   </features>
Nov 08 14:19:35 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:19:35 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:19:35 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:19:35 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:19:35 user nova-compute[87365]:   </clock>
Nov 08 14:19:35 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:19:35 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:19:35 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:19:35 user nova-compute[87365]:   </cpu>
Nov 08 14:19:35 user nova-compute[87365]:   <devices>
Nov 08 14:19:35 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:19:35 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:19:35 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk"/>
Nov 08 14:19:35 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:19:35 user nova-compute[87365]:     </disk>
Nov 08 14:19:35 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:19:35 user nova-compute[87365]:       <mac address="fa:16:3e:19:5e:78"/>
Nov 08 14:19:35 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:19:35 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:19:35 user nova-compute[87365]:       <target dev="tap024a96cb-c1"/>
Nov 08 14:19:35 user nova-compute[87365]:     </interface>
Nov 08 14:19:35 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:19:35 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/console.log" append="off"/>
Nov 08 14:19:35 user nova-compute[87365]:     </serial>
Nov 08 14:19:35 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:19:35 user nova-compute[87365]:     <video>
Nov 08 14:19:35 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:19:35 user nova-compute[87365]:     </video>
Nov 08 14:19:35 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:19:35 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:19:35 user nova-compute[87365]:     </rng>
Nov 08 14:19:35 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:19:35 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:19:35 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:19:35 user nova-compute[87365]:     </memballoon>
Nov 08 14:19:35 user nova-compute[87365]:   </devices>
Nov 08 14:19:35 user nova-compute[87365]: </domain>
Nov 08 14:19:35 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-952065685',display_name='tempest-AttachVolumeNegativeTest-server-952065685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-952065685',id=50,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2yLKnIS21ogacrL4y5WKCWXFBvZZ/Na9G3rBQnRi30dnO2QmgRLTeU8VXcZPgQiVzt6nDm8Q3TAl3DhGAyB5d4CXyOmeqIMeSw0I4xTULnRT2VAuDwlRdnbd6ZbmHUlA==',key_name='tempest-keypair-1231198605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-25tikm9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=f4589e37-0407-4667-b3a9-26009f6bef15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG os_vif [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7550e7e-576a-5840-807b-85646992a6b4', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap024a96cb-c1, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap024a96cb-c1, col_values=(('qos', UUID('ecd2fb26-7e3b-4346-9cf1-8bcb46603251')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap024a96cb-c1, col_values=(('external_ids', {'iface-id': '024a96cb-c114-46dd-acc3-3b85f0a9020a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:5e:78', 'vm-uuid': 'f4589e37-0407-4667-b3a9-26009f6bef15'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:35 user nova-compute[87365]: INFO os_vif [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1')
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:19:5e:78, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updated VIF entry in instance network info cache for port 024a96cb-c114-46dd-acc3-3b85f0a9020a. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG nova.network.neutron [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:19:35 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-11a0d866-3f21-4592-920b-0ed03e56518c req-efab69e3-809d-4263-bc53-75eebec32731 service nova] Releasing lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:36 user nova-compute[87365]: DEBUG nova.compute.manager [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] No waiting events found dispatching network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:19:36 user nova-compute[87365]: WARNING nova.compute.manager [req-5db2a2bb-9748-42e7-9271-c94b3750253e req-04ee5bad-64b8-41d3-9d80-96b0a0973962 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received unexpected event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a for instance with vm_state building and task_state spawning.
Nov 08 14:19:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:19:38 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Instance spawned successfully.
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:19:38 user nova-compute[87365]: INFO nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:38 user nova-compute[87365]: DEBUG nova.compute.manager [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] No waiting events found dispatching network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:19:38 user nova-compute[87365]: WARNING nova.compute.manager [req-25ac5f6e-7bf3-4c2f-82c3-2939e3549691 req-21b052ba-0c6c-49cf-a1c2-d3e1e69473e6 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received unexpected event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a for instance with vm_state building and task_state spawning.
Nov 08 14:19:38 user nova-compute[87365]: INFO nova.compute.manager [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Took 6.08 seconds to build instance.
Nov 08 14:19:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-553381a8-2ef9-4823-bfdf-ea742016e7bb tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.201s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:55 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:19:55 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:19:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=24.335739135742188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:19:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance b98acd51-548c-4ef9-b61d-10bc1a1a46be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f4589e37-0407-4667-b3a9-26009f6bef15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:19:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMBtkrTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:19:57 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:19:57 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:19:57 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cebd82-b9d6-4786-afa2-1df1e417e341]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:19:57 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a786b-3f29-4c6b-a72c-af43e7abaae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442] added
Nov 08 14:19:57 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff27ef-d009-45d2-a658-70d7a845159f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f8232-cb1a-4080-8a79-98f44baebe72]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMBtkrTf {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMBtkrTf" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53615d1-054f-448b-9d2b-f2f7981717e9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMBtkrTf'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[98164712-617a-4ac4-93c8-ece4005a6845]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbffedb-b3b0-4b2e-aea7-6d640f2cc93e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed016abc-c471-49be-8968-60782927b17b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260]
Nov 08 14:19:58 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260] successful.
Nov 08 14:19:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda3465-db50-416a-9db3-d18e3914f89d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8314eaec-6016-43ac-b4aa-d9e6279b59a8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:19:58 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8af135-44a9-4fc6-b20a-d636557d22e4]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:19:58 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMBtkrTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23831613466353536', 'path': '/dev/sdc'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831613466353536', 'path': '/dev/sdc'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.objects.instance [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:19:59 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:19:59 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:19:59 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:19:59 user nova-compute[87365]:   <serial>3731c89b-f487-4f0b-b61b-1769adc3e442</serial>
Nov 08 14:19:59 user nova-compute[87365]: </disk>
Nov 08 14:19:59 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No BDM found with device name vdc, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] No VIF found with MAC fa:16:3e:4e:8c:b0, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:19:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-b4393780-5f2e-406b-9061-bbf893e97b82 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.353s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:00 user nova-compute[87365]: INFO nova.compute.manager [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Detaching volume c21e59ad-1cd1-48e9-8fda-de07261760c8
Nov 08 14:20:00 user nova-compute[87365]: INFO nova.virt.block_device [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attempting to driver detach volume c21e59ad-1cd1-48e9-8fda-de07261760c8 from mountpoint /dev/vdb
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Attempting to detach device vdb from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:20:01 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:20:01 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:20:01 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:20:01 user nova-compute[87365]:   <serial>c21e59ad-1cd1-48e9-8fda-de07261760c8</serial>
Nov 08 14:20:01 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:20:01 user nova-compute[87365]: </disk>
Nov 08 14:20:01 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:20:01 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdb from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the persistent domain config.
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:20:01 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:20:01 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:20:01 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:20:01 user nova-compute[87365]:   <serial>c21e59ad-1cd1-48e9-8fda-de07261760c8</serial>
Nov 08 14:20:01 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:20:01 user nova-compute[87365]: </disk>
Nov 08 14:20:01 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:20:01 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [{"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-b98acd51-548c-4ef9-b61d-10bc1a1a46be" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:20:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 4 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:20:02 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Deletion of /opt/stack/data/nova/instances/de510f72-fe85-4b4f-8938-ca8976aaff02_resize failed
Nov 08 14:20:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:13 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:15 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:21 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be is timed out.
Nov 08 14:20:21 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdb from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the live domain config.
Nov 08 14:20:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jUSRaJIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:20:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c735ff-4bb2-428f-9db1-7e1504f6bc76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:20:21 user nova-compute[87365]: No targets found.
Nov 08 14:20:21 user nova-compute[87365]: iSNS:
Nov 08 14:20:21 user nova-compute[87365]: No targets found.
Nov 08 14:20:21 user nova-compute[87365]: STATIC:
Nov 08 14:20:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8
Nov 08 14:20:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:20:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:20:21 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442
Nov 08 14:20:21 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:20:21 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:20:21 user nova-compute[87365]: FIRMWARE:
Nov 08 14:20:21 user nova-compute[87365]: No targets found.
Nov 08 14:20:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:20:21 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:20:21 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[67357423-9392-4336-8967-e44c5129de9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094f84a-dc1f-4990-9f92-27a2425e9338]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:20:21 user nova-compute[87365]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:20:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 (non-flash)
Nov 08 14:20:21 user nova-compute[87365]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:20:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d18371fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[27000154-ebb8-40c4-a90f-cc9af30ff027]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01bcb73-7e2a-4d91-b23d-4ce4161a7478]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c78d30-13a1-440b-887e-510bf8c7de7f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b7ded-6260-4c74-aa3c-574ae2eabcef]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.122s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3ea962-f73f-4386-8a3b-a3d4ed34c361]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d714aa-a968-43cf-a3c4-00bcd88f91e6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260]
Nov 08 14:20:21 user nova-compute[87365]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8, portal: 172.16.0.220,3260] successful.
Nov 08 14:20:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c21e59ad-1cd1-48e9-8fda-de07261760c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb582f-2edf-40b7-a4dc-b3069866e767]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== disconnect_volume: return (404ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:20:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:20:22 user nova-compute[87365]: DEBUG nova.objects.instance [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-275f4767-16ee-427b-a906-ef0f997c08f0 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.202s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:23 user nova-compute[87365]: INFO nova.compute.manager [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Detaching volume 3731c89b-f487-4f0b-b61b-1769adc3e442
Nov 08 14:20:23 user nova-compute[87365]: INFO nova.virt.block_device [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Attempting to driver detach volume 3731c89b-f487-4f0b-b61b-1769adc3e442 from mountpoint /dev/vdc
Nov 08 14:20:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Attempting to detach device vdc from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:20:23 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:20:23 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:20:23 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:20:23 user nova-compute[87365]:   <serial>3731c89b-f487-4f0b-b61b-1769adc3e442</serial>
Nov 08 14:20:23 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 14:20:23 user nova-compute[87365]: </disk>
Nov 08 14:20:23 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:20:23 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdc from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the persistent domain config.
Nov 08 14:20:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:20:23 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:20:23 user nova-compute[87365]:   <source dev="/dev/sdc"/>
Nov 08 14:20:23 user nova-compute[87365]:   <target dev="vdc" bus="virtio"/>
Nov 08 14:20:23 user nova-compute[87365]:   <serial>3731c89b-f487-4f0b-b61b-1769adc3e442</serial>
Nov 08 14:20:23 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 14:20:23 user nova-compute[87365]: </disk>
Nov 08 14:20:23 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:20:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:43 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be is timed out.
Nov 08 14:20:43 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully detached device vdc from instance b98acd51-548c-4ef9-b61d-10bc1a1a46be from the live domain config.
Nov 08 14:20:43 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMBtkrTf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:20:43 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[1954bc76-24eb-4900-a7f6-9acf1d40eb03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:20:43 user nova-compute[87365]: No targets found.
Nov 08 14:20:43 user nova-compute[87365]: iSNS:
Nov 08 14:20:43 user nova-compute[87365]: No targets found.
Nov 08 14:20:43 user nova-compute[87365]: STATIC:
Nov 08 14:20:43 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442
Nov 08 14:20:43 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:20:43 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:20:43 user nova-compute[87365]: FIRMWARE:
Nov 08 14:20:43 user nova-compute[87365]: No targets found.
Nov 08 14:20:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:20:43 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:20:43 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5aa3d-4faf-42b1-86c7-d2083a41b104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8fbfe-c4ab-4edd-a223-da825abbb733]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:20:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 (non-flash)
Nov 08 14:20:43 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf859d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442'): ({'sdc'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Removing single pathed devices sdc {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:20:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8acca20-80f5-49ee-9140-6c39886cff7a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f398eb-25fd-4cb9-8bd9-c4b69f777793]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Flushing IO for device /dev/sdc {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3c97d-2600-49fb-8b23-669ef077d7d8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[91075daf-2984-4740-89b3-16163de0bbc9]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] SCSI volumes sdc have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e943c-71d2-433e-b503-50ced7126fba]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee68ef-d54f-4113-9268-e87414a1ae95]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260]
Nov 08 14:20:44 user nova-compute[87365]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442, portal: 172.16.0.220,3260] successful.
Nov 08 14:20:44 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3731c89b-f487-4f0b-b61b-1769adc3e442 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5213b9f9-e666-462b-88fd-031833dd65a9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] <== disconnect_volume: return (276ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:20:44 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'flavor' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1041149-ad55-4435-9bf3-86b6bf315da1 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.747s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:20:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:46 user nova-compute[87365]: INFO nova.compute.manager [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Terminating instance
Nov 08 14:20:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-unplugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] No waiting events found dispatching network-vif-unplugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:20:46 user nova-compute[87365]: DEBUG nova.compute.manager [req-3c619e91-2e05-4100-adea-b2cfa4fa4f94 req-23f5225d-978a-4a77-876d-0887553a9218 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-unplugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:20:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Instance destroyed successfully.
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lazy-loading 'resources' on Instance uuid b98acd51-548c-4ef9-b61d-10bc1a1a46be {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70532939',display_name='tempest-AttachVolumeTestJSON-server-70532939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70532939',id=49,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkZG7FRhNzPPRUqsq0sUawnAmW7oyrG3y5Zdx19CxL4qNaehVwsclDfDA2fzc5DOQdt2+Yc32cGusVNSEeo80CDQpn+2d7UbuY8OHIpR1qpLlifDUdMCYFrY/iyChpZeg==',key_name='tempest-keypair-1930524595',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c632e7ef13f4b03b843ce2996ecd29f',ramdisk_id='',reservation_id='r-u9b91xac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1235364264',owner_user_name='tempest-AttachVolumeTestJSON-1235364264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8951eb125524b84a913e2e66e857fbc',uuid=b98acd51-548c-4ef9-b61d-10bc1a1a46be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converting VIF {"id": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "address": "fa:16:3e:4e:8c:b0", "network": {"id": "b87e7245-5693-45ad-894f-99f2c0c737db", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1720922582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c632e7ef13f4b03b843ce2996ecd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00570c8-4b", "ovs_interfaceid": "b00570c8-4b80-4a48-90ff-a0d9851f3ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG os_vif [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00570c8-4b, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0141c5b-5d5f-4db1-aad4-23feef376e5f) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:47 user nova-compute[87365]: INFO os_vif [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8c:b0,bridge_name='br-int',has_traffic_filtering=True,id=b00570c8-4b80-4a48-90ff-a0d9851f3ad8,network=Network(b87e7245-5693-45ad-894f-99f2c0c737db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00570c8-4b')
Nov 08 14:20:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Deleting instance files /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be_del
Nov 08 14:20:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Deletion of /opt/stack/data/nova/instances/b98acd51-548c-4ef9-b61d-10bc1a1a46be_del complete
Nov 08 14:20:47 user nova-compute[87365]: INFO nova.compute.manager [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 14:20:47 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:20:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:20:48 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Took 0.87 seconds to deallocate network for instance.
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:48 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Deleted allocations for instance b98acd51-548c-4ef9-b61d-10bc1a1a46be
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7cfc93ba-4cbf-494e-97f8-4cc168fd6941 tempest-AttachVolumeTestJSON-1235364264 tempest-AttachVolumeTestJSON-1235364264-project-member] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] Acquiring lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] Lock "b98acd51-548c-4ef9-b61d-10bc1a1a46be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] No waiting events found dispatching network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:20:48 user nova-compute[87365]: WARNING nova.compute.manager [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received unexpected event network-vif-plugged-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 for instance with vm_state deleted and task_state None.
Nov 08 14:20:48 user nova-compute[87365]: DEBUG nova.compute.manager [req-e2744755-33f1-4416-b4de-4dd79688d39d req-733f4d73-c3d6-4c98-bc05-83cd89cd6792 service nova] [instance: b98acd51-548c-4ef9-b61d-10bc1a1a46be] Received event network-vif-deleted-b00570c8-4b80-4a48-90ff-a0d9851f3ad8 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:20:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:20:55 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:20:55 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.359230041503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f4589e37-0407-4667-b3a9-26009f6bef15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:20:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:20:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:20:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:57 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:20:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:20:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:21:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:21:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:21:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:21:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:21:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:21:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:21:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-changed-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:21:24 user nova-compute[87365]: DEBUG nova.compute.manager [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Refreshing instance network info cache due to event network-changed-024a96cb-c114-46dd-acc3-3b85f0a9020a. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:21:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] Acquiring lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:21:24 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] Acquired lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:21:24 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Refreshing network info cache for port 024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:21:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updated VIF entry in instance network info cache for port 024a96cb-c114-46dd-acc3-3b85f0a9020a. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:21:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:21:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c1806850-c393-4379-bbb8-6fb929c4562a req-2e2d4dc0-c512-4f9d-a331-08a7d6e4a735 service nova] Releasing lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:21:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG nova.objects.instance [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:31 user nova-compute[87365]: INFO nova.compute.manager [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Attaching volume 40777077-7825-46b6-8267-02445cd60fb2 to /dev/vdb
Nov 08 14:21:31 user nova-compute[87365]: DEBUG os_brick.utils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5029646-958e-46f3-ae02-1213cca84ba8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:31 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4132147-a960-4ab9-a4d2-ede6c0c0afdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[823fee5e-1fef-45c1-aa87-c89733b27d34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[211bf68c-a015-41e5-913d-02c3bb63fe01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:21:32 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:21:32 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[50677306-5f44-47b7-ad9c-1451fe8ee93c]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG os_brick.utils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating existing volume attachment record: 56c3136a-3409-4c11-b06e-0bb531a77b51 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:46 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:21:46 user nova-compute[87365]: INFO nova.compute.claims [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Claim successful on node user
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:21:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.policy [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c6a7ff5fa944500b1efad8434a43207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a867401c844ee8dab7695f9e6a44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:21:47 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Creating image(s)
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "1b931f745c86801dd64d583c87e466ae06ddba96" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "1b931f745c86801dd64d583c87e466ae06ddba96" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:47 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Successfully created port: a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.part --force-share --output=json" returned: 0 in 0.211s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG nova.virt.images [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] f1c06d1f-0144-462f-877e-74c289442d59 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.part /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.part /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.converted" returned: 0 in 0.277s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "1b931f745c86801dd64d583c87e466ae06ddba96" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.165s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "1b931f745c86801dd64d583c87e466ae06ddba96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "1b931f745c86801dd64d583c87e466ae06ddba96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:48 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96,backing_fmt=raw /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96,backing_fmt=raw /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk 1073741824" returned: 0 in 0.078s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "1b931f745c86801dd64d583c87e466ae06ddba96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Successfully updated port: a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing instance network info cache due to event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-1ee03466-b1bb-415c-bb75-d5a648279a93 req-6f0ae210-a5fb-41a0-bb19-642eefd7aaea service nova] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Cannot resize image /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Ensure instance console log exists: /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance network_info: |[{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start _get_guest_xml network_info=[{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T14:21:44Z,direct_url=<?>,disk_format='qcow2',id=f1c06d1f-0144-462f-877e-74c289442d59,min_disk=0,min_ram=0,name='tempest-scenario-img--994256117',owner='4c6a867401c844ee8dab7695f9e6a44b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T14:21:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f1c06d1f-0144-462f-877e-74c289442d59'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:21:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:21:49 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T14:21:44Z,direct_url=<?>,disk_format='qcow2',id=f1c06d1f-0144-462f-877e-74c289442d59,min_disk=0,min_ram=0,name='tempest-scenario-img--994256117',owner='4c6a867401c844ee8dab7695f9e6a44b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T14:21:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:21:47Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.objects.instance [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:21:49 user nova-compute[87365]:   <uuid>60ae3077-6475-4d3c-aa10-a239f7cd854f</uuid>
Nov 08 14:21:49 user nova-compute[87365]:   <name>instance-00000033</name>
Nov 08 14:21:49 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:21:49 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:21:49 user nova-compute[87365]:   <metadata>
Nov 08 14:21:49 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:21:49 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:name>tempest-TestMinimumBasicScenario-server-1872760598</nova:name>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:21:49</nova:creationTime>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:21:49 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:21:49 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:owner>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:user uuid="1c6a7ff5fa944500b1efad8434a43207">tempest-TestMinimumBasicScenario-1047379247-project-member</nova:user>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:project uuid="4c6a867401c844ee8dab7695f9e6a44b">tempest-TestMinimumBasicScenario-1047379247</nova:project>
Nov 08 14:21:49 user nova-compute[87365]:       </nova:owner>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:root type="image" uuid="f1c06d1f-0144-462f-877e-74c289442d59"/>
Nov 08 14:21:49 user nova-compute[87365]:       <nova:ports>
Nov 08 14:21:49 user nova-compute[87365]:         <nova:port uuid="a54ad634-6e9e-446e-9118-75e5724d662f">
Nov 08 14:21:49 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 14:21:49 user nova-compute[87365]:         </nova:port>
Nov 08 14:21:49 user nova-compute[87365]:       </nova:ports>
Nov 08 14:21:49 user nova-compute[87365]:     </nova:instance>
Nov 08 14:21:49 user nova-compute[87365]:   </metadata>
Nov 08 14:21:49 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:21:49 user nova-compute[87365]:     <system>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="serial">60ae3077-6475-4d3c-aa10-a239f7cd854f</entry>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="uuid">60ae3077-6475-4d3c-aa10-a239f7cd854f</entry>
Nov 08 14:21:49 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:21:49 user nova-compute[87365]:     </system>
Nov 08 14:21:49 user nova-compute[87365]:   </sysinfo>
Nov 08 14:21:49 user nova-compute[87365]:   <os>
Nov 08 14:21:49 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:21:49 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:21:49 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:21:49 user nova-compute[87365]:   </os>
Nov 08 14:21:49 user nova-compute[87365]:   <features>
Nov 08 14:21:49 user nova-compute[87365]:     <acpi/>
Nov 08 14:21:49 user nova-compute[87365]:     <apic/>
Nov 08 14:21:49 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:21:49 user nova-compute[87365]:   </features>
Nov 08 14:21:49 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:21:49 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:21:49 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:21:49 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:21:49 user nova-compute[87365]:   </clock>
Nov 08 14:21:49 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:21:49 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:21:49 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:21:49 user nova-compute[87365]:   </cpu>
Nov 08 14:21:49 user nova-compute[87365]:   <devices>
Nov 08 14:21:49 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:21:49 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:21:49 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk"/>
Nov 08 14:21:49 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:21:49 user nova-compute[87365]:     </disk>
Nov 08 14:21:49 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:21:49 user nova-compute[87365]:       <mac address="fa:16:3e:0d:45:44"/>
Nov 08 14:21:49 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:21:49 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:21:49 user nova-compute[87365]:       <target dev="tapa54ad634-6e"/>
Nov 08 14:21:49 user nova-compute[87365]:     </interface>
Nov 08 14:21:49 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:21:49 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/console.log" append="off"/>
Nov 08 14:21:49 user nova-compute[87365]:     </serial>
Nov 08 14:21:49 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:21:49 user nova-compute[87365]:     <video>
Nov 08 14:21:49 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:21:49 user nova-compute[87365]:     </video>
Nov 08 14:21:49 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:21:49 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:21:49 user nova-compute[87365]:     </rng>
Nov 08 14:21:49 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:21:49 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:21:49 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:21:49 user nova-compute[87365]:     </memballoon>
Nov 08 14:21:49 user nova-compute[87365]:   </devices>
Nov 08 14:21:49 user nova-compute[87365]: </domain>
Nov 08 14:21:49 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:21:47Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG os_vif [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1a78f32-8e4c-5c67-9ab9-831e31d00831', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54ad634-6e, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa54ad634-6e, col_values=(('qos', UUID('bf18023f-1d5d-44ff-b224-d7df601b4e4d')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa54ad634-6e, col_values=(('external_ids', {'iface-id': 'a54ad634-6e9e-446e-9118-75e5724d662f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:45:44', 'vm-uuid': '60ae3077-6475-4d3c-aa10-a239f7cd854f'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:49 user nova-compute[87365]: INFO os_vif [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e')
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:21:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No VIF found with MAC fa:16:3e:0d:45:44, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:21:51 user nova-compute[87365]: WARNING nova.compute.manager [req-8f81db0f-f996-4bae-8240-fc1dee90f759 req-70fcab8a-5060-4bd3-b550-2a04d1920236 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state building and task_state spawning.
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:51 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:21:53 user nova-compute[87365]: WARNING nova.compute.manager [req-892b155f-8d74-4b43-a8ec-20c348fb7eb1 req-1ba88444-dd4a-49f3-b6b4-5f8eadc3507f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state building and task_state spawning.
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:21:53 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance spawned successfully.
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:21:53 user nova-compute[87365]: INFO nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 08 14:21:53 user nova-compute[87365]: DEBUG nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:21:53 user nova-compute[87365]: INFO nova.compute.manager [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Took 6.97 seconds to build instance.
Nov 08 14:21:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-7405501a-a5a7-4434-96ef-61ad2ed27159 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.084s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRktmaZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:21:54 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:21:54 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:21:54 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72717b-5e81-4614-bd80-f95efff7e9ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:21:54 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d165c5ad-a416-4a74-be29-df486e662520]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2] added
Nov 08 14:21:54 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46950d-5e9d-4aea-95eb-caefa5935a93]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bbe844-d8bf-4727-badf-3646add0c43f]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRktmaZl {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRktmaZl" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e32f64f-6ec5-4183-9035-c340b994dfe4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRktmaZl'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:54 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[313162bd-b710-4c97-b7c6-b6b2f35278bd]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c3ecf1-b6d4-428a-80c3-07a2103cc433]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:21:55 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:21:55 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:21:55 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:21:55 user nova-compute[87365]: 
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba0b854-e911-4029-8659-c1548de514de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260]
Nov 08 14:21:55 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260] successful.
Nov 08 14:21:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c0b87-a2ff-479f-825d-2e3a6b2a773d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb453119-9316-42bf-ad17-4b9599683499]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)
Nov 08 14:21:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)
Nov 08 14:21:55 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb6cd0-9559-407d-aa9d-ff1c9ad2d5ed]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:21:55 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRktmaZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26361643237396538', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361643237396538', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG nova.objects.instance [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:21:56 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:21:56 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:21:56 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:21:56 user nova-compute[87365]:   <serial>40777077-7825-46b6-8267-02445cd60fb2</serial>
Nov 08 14:21:56 user nova-compute[87365]: </disk>
Nov 08 14:21:56 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:21:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.384s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] No VIF found with MAC fa:16:3e:19:5e:78, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-86329f5c-fafa-4520-921d-875f62e8ad19 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.560s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:21:57 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:21:58 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:21:58 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=24.286693572998047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:21:58 user nova-compute[87365]: INFO nova.compute.manager [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Detaching volume 40777077-7825-46b6-8267-02445cd60fb2
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance f4589e37-0407-4667-b3a9-26009f6bef15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:21:58 user nova-compute[87365]: INFO nova.virt.block_device [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Attempting to driver detach volume 40777077-7825-46b6-8267-02445cd60fb2 from mountpoint /dev/vdb
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Attempting to detach device vdb from instance f4589e37-0407-4667-b3a9-26009f6bef15 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:21:58 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:21:58 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:21:58 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:21:58 user nova-compute[87365]:   <serial>40777077-7825-46b6-8267-02445cd60fb2</serial>
Nov 08 14:21:58 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:21:58 user nova-compute[87365]: </disk>
Nov 08 14:21:58 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:21:58 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance f4589e37-0407-4667-b3a9-26009f6bef15 from the persistent domain config.
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4589e37-0407-4667-b3a9-26009f6bef15 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:21:58 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:21:58 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:21:58 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:21:58 user nova-compute[87365]:   <serial>40777077-7825-46b6-8267-02445cd60fb2</serial>
Nov 08 14:21:58 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:21:58 user nova-compute[87365]: </disk>
Nov 08 14:21:58 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:21:58 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:21:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:22:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:22:03 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [{"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:22:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-f4589e37-0407-4667-b3a9-26009f6bef15" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:22:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:22:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:07 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:18 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4589e37-0407-4667-b3a9-26009f6bef15 is timed out.
Nov 08 14:22:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully detached device vdb from instance f4589e37-0407-4667-b3a9-26009f6bef15 from the live domain config.
Nov 08 14:22:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRktmaZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:22:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de08bea-8337-4f4b-ba97-dda8611a4755]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:22:18 user nova-compute[87365]: No targets found.
Nov 08 14:22:18 user nova-compute[87365]: iSNS:
Nov 08 14:22:18 user nova-compute[87365]: No targets found.
Nov 08 14:22:18 user nova-compute[87365]: STATIC:
Nov 08 14:22:18 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2
Nov 08 14:22:18 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:22:18 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:22:18 user nova-compute[87365]: FIRMWARE:
Nov 08 14:22:18 user nova-compute[87365]: No targets found.
Nov 08 14:22:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:22:18 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:22:18 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc6c8b-29a6-4b7d-9e9e-fc626ad87dbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1130962-9038-47a5-84ff-36073223b8fa]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)
Nov 08 14:22:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 (non-flash)
Nov 08 14:22:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf8743be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ab888-81d8-4eaf-aa60-fc2f11c9ef1f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b807881-0654-446c-a9da-935b77d2a470]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:22:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d050b-f9e2-4d44-8362-17fbbae22254]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ec01ca-c23e-433f-b94c-dd143662601d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc32236-5cec-439b-8b4f-3e30a32baf92]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[183aa1d2-384f-4efc-849b-87f9d3764e5f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260]
Nov 08 14:22:19 user nova-compute[87365]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2, portal: 172.16.0.220,3260] successful.
Nov 08 14:22:19 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40777077-7825-46b6-8267-02445cd60fb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22fe4b9-70ae-450d-88bf-76cbabda896a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] <== disconnect_volume: return (280ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:22:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'flavor' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:22:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-d1da3d4c-ba50-40a0-be72-615112d01f1f tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:22:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:22:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:48 user nova-compute[87365]: INFO nova.compute.manager [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Terminating instance
Nov 08 14:22:48 user nova-compute[87365]: DEBUG nova.compute.manager [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-unplugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] No waiting events found dispatching network-vif-unplugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.compute.manager [req-6fdbec9f-71c3-4289-8a49-262edc7b7685 req-6c6266b2-e8fc-4378-a19e-38bfaf1460cc service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-unplugged-024a96cb-c114-46dd-acc3-3b85f0a9020a for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:22:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Instance destroyed successfully.
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.objects.instance [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lazy-loading 'resources' on Instance uuid f4589e37-0407-4667-b3a9-26009f6bef15 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-952065685',display_name='tempest-AttachVolumeNegativeTest-server-952065685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-952065685',id=50,image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2yLKnIS21ogacrL4y5WKCWXFBvZZ/Na9G3rBQnRi30dnO2QmgRLTeU8VXcZPgQiVzt6nDm8Q3TAl3DhGAyB5d4CXyOmeqIMeSw0I4xTULnRT2VAuDwlRdnbd6ZbmHUlA==',key_name='tempest-keypair-1231198605',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e58ecaf473940859738817c8a91b64c',ramdisk_id='',reservation_id='r-25tikm9w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='46f8fdd3-d1a7-4c1e-99ed-3f27fd8ae6dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1316129282',owner_user_name='tempest-AttachVolumeNegativeTest-1316129282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25f500e55fac46c59f38b0cd17172299',uuid=f4589e37-0407-4667-b3a9-26009f6bef15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converting VIF {"id": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "address": "fa:16:3e:19:5e:78", "network": {"id": "66fab1df-5d6e-4ce4-afd9-79e822d85d96", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1201627824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e58ecaf473940859738817c8a91b64c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap024a96cb-c1", "ovs_interfaceid": "024a96cb-c114-46dd-acc3-3b85f0a9020a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG os_vif [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap024a96cb-c1, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecd2fb26-7e3b-4346-9cf1-8bcb46603251) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:22:49 user nova-compute[87365]: INFO os_vif [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:5e:78,bridge_name='br-int',has_traffic_filtering=True,id=024a96cb-c114-46dd-acc3-3b85f0a9020a,network=Network(66fab1df-5d6e-4ce4-afd9-79e822d85d96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap024a96cb-c1')
Nov 08 14:22:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Deleting instance files /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15_del
Nov 08 14:22:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Deletion of /opt/stack/data/nova/instances/f4589e37-0407-4667-b3a9-26009f6bef15_del complete
Nov 08 14:22:49 user nova-compute[87365]: INFO nova.compute.manager [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 14:22:49 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:22:49 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:22:50 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Took 0.84 seconds to deallocate network for instance.
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-45bd901b-7165-4b27-b995-88c81c72320e req-2ff5c1eb-e23b-4769-baa6-7cde35465daf service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-deleted-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:22:50 user nova-compute[87365]: INFO nova.compute.manager [req-45bd901b-7165-4b27-b995-88c81c72320e req-2ff5c1eb-e23b-4769-baa6-7cde35465daf service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Neutron deleted interface 024a96cb-c114-46dd-acc3-3b85f0a9020a; detaching it from the instance and deleting it from the info cache
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.network.neutron [req-45bd901b-7165-4b27-b995-88c81c72320e req-2ff5c1eb-e23b-4769-baa6-7cde35465daf service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.compute.manager [req-45bd901b-7165-4b27-b995-88c81c72320e req-2ff5c1eb-e23b-4769-baa6-7cde35465daf service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Detach interface failed, port_id=024a96cb-c114-46dd-acc3-3b85f0a9020a, reason: Instance f4589e37-0407-4667-b3a9-26009f6bef15 could not be found. {{(pid=87365) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:22:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:50 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Deleted allocations for instance f4589e37-0407-4667-b3a9-26009f6bef15
Nov 08 14:22:50 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-8038bd52-26c5-4ef6-b707-52c92f557f55 tempest-AttachVolumeNegativeTest-1316129282 tempest-AttachVolumeNegativeTest-1316129282-project-member] Lock "f4589e37-0407-4667-b3a9-26009f6bef15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:22:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] Acquiring lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] Lock "f4589e37-0407-4667-b3a9-26009f6bef15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] No waiting events found dispatching network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:22:51 user nova-compute[87365]: WARNING nova.compute.manager [req-2512b9ea-53f9-4feb-bed9-4b10949dff82 req-3cced040-f474-4189-a1e3-5456b91ef06c service nova] [instance: f4589e37-0407-4667-b3a9-26009f6bef15] Received unexpected event network-vif-plugged-024a96cb-c114-46dd-acc3-3b85f0a9020a for instance with vm_state deleted and task_state None.
Nov 08 14:22:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:22:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:56 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:22:57 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:22:57 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.284832000732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:22:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:22:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:23:04 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:23:05 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:23:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:23:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:23:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:23:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:23:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:23:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:23:43 user nova-compute[87365]: INFO nova.compute.manager [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Attaching volume 2702aa48-1c39-4ff4-b667-611094014f9d to /dev/vdb
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.utils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf6eb3-6630-45e0-880c-a763063563d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4419dde4-dd4b-4b57-bf81-236a0adfedb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5afca-d3d6-4544-82d6-57204646a4ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f88f0-fafc-4fb0-bef9-e3b82cb88b2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:23:43 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:23:43 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[701230f1-e155-43ca-9cc4-0416b0d59939]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG os_brick.utils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:23:43 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating existing volume attachment record: 66bb8c66-1cb0-4c24-b51a-e61e4ff1318a {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:23:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:47 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:55 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:23:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:23:58 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:23:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:23:59 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=24.282501220703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:23:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:24:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:24:04 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:24:05 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:24:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:24:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:24:09 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:14 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:16 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:24:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:24:21 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:24:21 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2fc4d-309e-42af-8ff3-b3d4f456c5cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:24:21 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[58378dbb-ab17-47f4-bef1-6632d9602c4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d] added
Nov 08 14:24:21 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0c93a-413a-4213-81f8-c7edd8c7a8db]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:21 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[db76e0d2-040c-4ab2-809f-3d62b480717a]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyMpcvUo {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyMpcvUo" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14041cd4-2062-4fbd-9698-e6f011c639f9]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyMpcvUo'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14b4f1-dc1f-4de4-a8b5-005dbf3b3726]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dead2573-bfb2-4d2e-97e3-55c4b74c5a48]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:24:22 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:24:22 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:24:22 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:24:22 user nova-compute[87365]: 
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[55128394-8e7e-4b06-9e9a-a5508d02ba73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]
Nov 08 14:24:22 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.
Nov 08 14:24:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd3d16-9ec1-4d2c-b0c1-ce9d11e22261]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e48a4-2d39-42aa-ba5f-55af815eba99]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:24:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:24:22 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf997f8-cb9d-4fa5-a47c-5346bc21a3fa]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:24:22 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23635333036663865', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635333036663865', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.objects.instance [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:24:23 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:24:23 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:24:23 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:24:23 user nova-compute[87365]:   <serial>2702aa48-1c39-4ff4-b667-611094014f9d</serial>
Nov 08 14:24:23 user nova-compute[87365]: </disk>
Nov 08 14:24:23 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No VIF found with MAC fa:16:3e:0d:45:44, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:24:23 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-ae2a0c15-73c1-4760-8a3b-451c39a793b6 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.111s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:24:24 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:24:29 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:34 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:24:37 user nova-compute[87365]: DEBUG nova.compute.manager [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing instance network info cache due to event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:24:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:24:37 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:24:37 user nova-compute[87365]: DEBUG nova.network.neutron [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:24:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated VIF entry in instance network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:24:38 user nova-compute[87365]: DEBUG nova.network.neutron [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:24:38 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-86d2d049-e5cd-4182-ba15-ac4e1a726330 req-e47f1041-6cdc-42b4-bb33-fc34245ca720 service nova] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:24:39 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG nova.compute.manager [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing instance network info cache due to event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated VIF entry in instance network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG nova.network.neutron [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:24:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-eb033484-cfa2-4954-8d4a-844bf64722c0 req-3d5f3227-a315-4ead-afc5-de75ca8f01fa service nova] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:24:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:44 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:48 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:49 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:24:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:24:58 user nova-compute[87365]: INFO nova.compute.manager [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Rebooting instance
Nov 08 14:24:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:24:58 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG nova.network.neutron [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:24:59 user nova-compute[87365]: DEBUG nova.compute.manager [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:24:59 user nova-compute[87365]: WARNING nova.compute.manager [req-ef327fc5-47ff-4618-8b3e-4d822f0ee314 req-5eb3b932-52df-46d1-8850-009e41e7838a service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance destroyed successfully.
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'resources' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:24:59Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54ad634-6e, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf18023f-1d5d-44ff-b224-d7df601b4e4d) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:25:00 user nova-compute[87365]: INFO os_vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e')
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:25:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9180a-b635-4148-a238-bd4152914f51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:25:00 user nova-compute[87365]: No targets found.
Nov 08 14:25:00 user nova-compute[87365]: iSNS:
Nov 08 14:25:00 user nova-compute[87365]: No targets found.
Nov 08 14:25:00 user nova-compute[87365]: STATIC:
Nov 08 14:25:00 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d
Nov 08 14:25:00 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:25:00 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:25:00 user nova-compute[87365]: FIRMWARE:
Nov 08 14:25:00 user nova-compute[87365]: No targets found.
Nov 08 14:25:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:25:00 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:25:00 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0daac-8ebe-470c-930e-1d2f7cc5fc57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9cba87-13d6-4c6f-90fa-00927ce150e5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:25:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:25:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cf85684c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e802d9d1-4ebc-489b-8b8b-088477ff707c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed2cc7-db66-4f1f-9be7-862e24c3433a]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e6f4dd-4cdb-4400-a9f2-9b9ffb68fb44]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f4a4a7-c28a-4910-a941-696f39eef801]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19e331-55ff-414c-9027-238b12a1a813]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0e14b-3a8e-461c-8c4c-7e4c7e6a0332]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]
Nov 08 14:25:00 user nova-compute[87365]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.
Nov 08 14:25:00 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f08ab-a6f5-4d3f-87f5-f55b4956ebfc]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== disconnect_volume: return (338ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start _get_guest_xml network_info=[{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c06d1f-0144-462f-877e-74c289442d59,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f1c06d1f-0144-462f-877e-74c289442d59'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '60ae3077-6475-4d3c-aa10-a239f7cd854f', 'attached_at': '', 'detached_at': '', 'volume_id': '2702aa48-1c39-4ff4-b667-611094014f9d', 'serial': '2702aa48-1c39-4ff4-b667-611094014f9d'}, 'attachment_id': '66bb8c66-1cb0-4c24-b51a-e61e4ff1318a', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:25:00 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:25:00 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f1c06d1f-0144-462f-877e-74c289442d59,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.objects.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Object Instance<60ae3077-6475-4d3c-aa10-a239f7cd854f> lazy-loaded attributes: resources,vcpu_model {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:25:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:25:00 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:25:00 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53cd33-81ac-4589-b2a7-5a28fa189599]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:25:00 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abc0584-a5a7-4ce5-89d2-2f6f9940287d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d] added
Nov 08 14:25:01 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.271648406982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[925a275d-c102-499c-a7e8-5adc718daf22]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd05541-e8f8-49c5-b30e-9034d6378be8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyMpcvUo {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uyMpcvUo" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cba6f25-976c-4d5e-a02d-b5d07a747134]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uyMpcvUo'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c5f99c-3e8b-481c-8c3d-e4376c7912f4]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e8e4e-79ae-4409-94b6-24133e58b8ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:25:01 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:25:01 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:25:01 user nova-compute[87365]: 
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc73d7f1-6179-41ec-ad94-bd9207af1e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]
Nov 08 14:25:01 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.
Nov 08 14:25:01 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0a608-0040-42b8-bd98-333bf184bc1c]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c01a5-9fa1-4e64-b32b-ba173a5d67af]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:25:01 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:25:01 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.694s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ae00e-a30c-40a1-b2a4-02684a538335]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:01 user nova-compute[87365]: DEBUG nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:01 user nova-compute[87365]: WARNING nova.compute.manager [req-458d6dfa-62dd-4b8a-8cb1-e66daed1f784 req-f4bf3067-8ca2-4d91-80f4-b534873ea3b1 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:02 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.722s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== connect_volume: return (1723ms) {'type': 'block', 'scsi_wwn': '23635333036663865', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635333036663865', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:24:59Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.objects.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Object Instance<60ae3077-6475-4d3c-aa10-a239f7cd854f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:25:02 user nova-compute[87365]:   <uuid>60ae3077-6475-4d3c-aa10-a239f7cd854f</uuid>
Nov 08 14:25:02 user nova-compute[87365]:   <name>instance-00000033</name>
Nov 08 14:25:02 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:25:02 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:25:02 user nova-compute[87365]:   <metadata>
Nov 08 14:25:02 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:25:02 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:name>tempest-TestMinimumBasicScenario-server-1872760598</nova:name>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:25:00</nova:creationTime>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:25:02 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:25:02 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:owner>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:user uuid="1c6a7ff5fa944500b1efad8434a43207">tempest-TestMinimumBasicScenario-1047379247-project-member</nova:user>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:project uuid="4c6a867401c844ee8dab7695f9e6a44b">tempest-TestMinimumBasicScenario-1047379247</nova:project>
Nov 08 14:25:02 user nova-compute[87365]:       </nova:owner>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:root type="image" uuid="f1c06d1f-0144-462f-877e-74c289442d59"/>
Nov 08 14:25:02 user nova-compute[87365]:       <nova:ports>
Nov 08 14:25:02 user nova-compute[87365]:         <nova:port uuid="a54ad634-6e9e-446e-9118-75e5724d662f">
Nov 08 14:25:02 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 14:25:02 user nova-compute[87365]:         </nova:port>
Nov 08 14:25:02 user nova-compute[87365]:       </nova:ports>
Nov 08 14:25:02 user nova-compute[87365]:     </nova:instance>
Nov 08 14:25:02 user nova-compute[87365]:   </metadata>
Nov 08 14:25:02 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:25:02 user nova-compute[87365]:     <system>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="serial">60ae3077-6475-4d3c-aa10-a239f7cd854f</entry>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="uuid">60ae3077-6475-4d3c-aa10-a239f7cd854f</entry>
Nov 08 14:25:02 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:25:02 user nova-compute[87365]:     </system>
Nov 08 14:25:02 user nova-compute[87365]:   </sysinfo>
Nov 08 14:25:02 user nova-compute[87365]:   <os>
Nov 08 14:25:02 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:25:02 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:25:02 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:25:02 user nova-compute[87365]:   </os>
Nov 08 14:25:02 user nova-compute[87365]:   <features>
Nov 08 14:25:02 user nova-compute[87365]:     <acpi/>
Nov 08 14:25:02 user nova-compute[87365]:     <apic/>
Nov 08 14:25:02 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:25:02 user nova-compute[87365]:   </features>
Nov 08 14:25:02 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:25:02 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:25:02 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:25:02 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:25:02 user nova-compute[87365]:   </clock>
Nov 08 14:25:02 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:25:02 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:25:02 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:25:02 user nova-compute[87365]:   </cpu>
Nov 08 14:25:02 user nova-compute[87365]:   <devices>
Nov 08 14:25:02 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:25:02 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:25:02 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk"/>
Nov 08 14:25:02 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:25:02 user nova-compute[87365]:     </disk>
Nov 08 14:25:02 user nova-compute[87365]:     <disk type="block" device="disk">
Nov 08 14:25:02 user nova-compute[87365]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:25:02 user nova-compute[87365]:       <source dev="/dev/sdb"/>
Nov 08 14:25:02 user nova-compute[87365]:       <target dev="vdb" bus="virtio"/>
Nov 08 14:25:02 user nova-compute[87365]:       <serial>2702aa48-1c39-4ff4-b667-611094014f9d</serial>
Nov 08 14:25:02 user nova-compute[87365]:     </disk>
Nov 08 14:25:02 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:25:02 user nova-compute[87365]:       <mac address="fa:16:3e:0d:45:44"/>
Nov 08 14:25:02 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:25:02 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:25:02 user nova-compute[87365]:       <target dev="tapa54ad634-6e"/>
Nov 08 14:25:02 user nova-compute[87365]:     </interface>
Nov 08 14:25:02 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:25:02 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/console.log" append="off"/>
Nov 08 14:25:02 user nova-compute[87365]:     </serial>
Nov 08 14:25:02 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:25:02 user nova-compute[87365]:     <video>
Nov 08 14:25:02 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:25:02 user nova-compute[87365]:     </video>
Nov 08 14:25:02 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:25:02 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:25:02 user nova-compute[87365]:     </rng>
Nov 08 14:25:02 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:25:02 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:25:02 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:25:02 user nova-compute[87365]:     </memballoon>
Nov 08 14:25:02 user nova-compute[87365]:   </devices>
Nov 08 14:25:02 user nova-compute[87365]: </domain>
Nov 08 14:25:02 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG nova.objects.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Object Instance<60ae3077-6475-4d3c-aa10-a239f7cd854f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:25:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b931f745c86801dd64d583c87e466ae06ddba96 --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Cannot resize image /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.objects.instance [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'migration_context' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.objects.base [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Object Instance<60ae3077-6475-4d3c-aa10-a239f7cd854f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=87365) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:24:59Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG os_vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1a78f32-8e4c-5c67-9ab9-831e31d00831', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa54ad634-6e, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa54ad634-6e, col_values=(('qos', UUID('a2e6cb94-e161-412a-9116-79a7112e2c5e')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa54ad634-6e, col_values=(('external_ids', {'iface-id': 'a54ad634-6e9e-446e-9118-75e5724d662f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:45:44', 'vm-uuid': '60ae3077-6475-4d3c-aa10-a239f7cd854f'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:25:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:03 user nova-compute[87365]: INFO os_vif [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e')
Nov 08 14:25:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:04 user nova-compute[87365]: DEBUG nova.compute.manager [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:04 user nova-compute[87365]: WARNING nova.compute.manager [req-9ab6bafb-a1fe-4024-939f-089685a1aea4 req-723d04ea-bdd8-4202-9b58-397b95dec840 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state reboot_started_hard.
Nov 08 14:25:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:25:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:25:05 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 5 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:25:06 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance rebooted successfully.
Nov 08 14:25:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-2de6bb70-967b-4ac9-af13-309c406523ba tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.216s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:25:07 user nova-compute[87365]: DEBUG nova.compute.manager [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:25:07 user nova-compute[87365]: WARNING nova.compute.manager [req-d9cef093-619a-422a-aced-7376a5defb90 req-fa65600c-c16f-4b6a-83ef-08fc0419e34b service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state active and task_state None.
Nov 08 14:25:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:23 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:25:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:25:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:25:58 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:25:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:26:00 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:26:01 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:26:01 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=24.269573211669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:26:01 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:26:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:03 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:26:08 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:26:09 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:26:09 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:26:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:26:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:23 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:41 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing instance network info cache due to event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated VIF entry in instance network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-635e6f1d-ac61-4b60-a579-4aeb125c866e req-ecde35cc-fb20-49ce-98a2-529877426b30 service nova] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing instance network info cache due to event network-changed-a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:26:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Refreshing network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:26:52 user nova-compute[87365]: INFO nova.compute.manager [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Detaching volume 2702aa48-1c39-4ff4-b667-611094014f9d
Nov 08 14:26:52 user nova-compute[87365]: INFO nova.virt.block_device [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Attempting to driver detach volume 2702aa48-1c39-4ff4-b667-611094014f9d from mountpoint /dev/vdb
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Attempting to detach device vdb from instance 60ae3077-6475-4d3c-aa10-a239f7cd854f from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:26:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:26:52 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:26:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:26:52 user nova-compute[87365]:   <serial>2702aa48-1c39-4ff4-b667-611094014f9d</serial>
Nov 08 14:26:52 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 14:26:52 user nova-compute[87365]: </disk>
Nov 08 14:26:52 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:26:52 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully detached device vdb from instance 60ae3077-6475-4d3c-aa10-a239f7cd854f from the persistent domain config.
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60ae3077-6475-4d3c-aa10-a239f7cd854f from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:26:52 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:26:52 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:26:52 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:26:52 user nova-compute[87365]:   <serial>2702aa48-1c39-4ff4-b667-611094014f9d</serial>
Nov 08 14:26:52 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 14:26:52 user nova-compute[87365]: </disk>
Nov 08 14:26:52 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated VIF entry in instance network info cache for port a54ad634-6e9e-446e-9118-75e5724d662f. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5725cfb7-08f8-4158-8048-f7fd61a8b06b req-19a47512-cbf1-43c1-8ac0-29da630c9b08 service nova] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:26:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:26:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:26:58 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:26:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:00 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:02 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:27:03 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=24.267581939697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 60ae3077-6475-4d3c-aa10-a239f7cd854f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:27:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:08 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:27:10 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:27:11 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [{"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:27:11 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-60ae3077-6475-4d3c-aa10-a239f7cd854f" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:27:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:12 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60ae3077-6475-4d3c-aa10-a239f7cd854f is timed out.
Nov 08 14:27:12 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully detached device vdb from instance 60ae3077-6475-4d3c-aa10-a239f7cd854f from the live domain config.
Nov 08 14:27:12 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uyMpcvUo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:27:12 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dcec95-9779-43c2-9a87-e3fc61580561]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:27:12 user nova-compute[87365]: No targets found.
Nov 08 14:27:12 user nova-compute[87365]: iSNS:
Nov 08 14:27:12 user nova-compute[87365]: No targets found.
Nov 08 14:27:12 user nova-compute[87365]: STATIC:
Nov 08 14:27:12 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d
Nov 08 14:27:12 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:27:12 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:27:12 user nova-compute[87365]: FIRMWARE:
Nov 08 14:27:12 user nova-compute[87365]: No targets found.
Nov 08 14:27:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:27:12 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:27:12 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e6f95-fcbd-4620-930b-ae8c2710d376]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce02c3c1-3129-4045-a3ec-2179e4756997]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:27:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d (non-flash)
Nov 08 14:27:12 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3d180a4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52bd26-cc42-4f63-a556-81f5fbbb79a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2029d7-a8a1-4874-b029-ade876552e9f]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57bce70-c01e-4ee5-bb68-fe4e2e454bbe]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:27:12 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbbce3-6248-40b3-8826-46cbbda20056]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e5e9b-5095-4b98-8f8a-8eaa20f478ea]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0dd0f-403d-4467-8a1d-8bc911c336c7]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260]
Nov 08 14:27:13 user nova-compute[87365]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d, portal: 172.16.0.220,3260] successful.
Nov 08 14:27:13 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2702aa48-1c39-4ff4-b667-611094014f9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8828d95-1d67-4a6c-8769-a7eab2a61c01]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== disconnect_volume: return (261ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:27:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:18 user nova-compute[87365]: DEBUG nova.objects.instance [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:27:18 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-3e0114f0-d513-4834-98e0-0b5775ff0d7f tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.226s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:23 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:33 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:38 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:43 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:48 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:49 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:27:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:54 user nova-compute[87365]: INFO nova.compute.manager [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Terminating instance
Nov 08 14:27:54 user nova-compute[87365]: DEBUG nova.compute.manager [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.compute.manager [req-253efc6e-7c37-4ed2-9ee0-43b037584c7a req-23282b11-9451-40e5-be2d-6ec63962d8aa service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-unplugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:27:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Instance destroyed successfully.
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'resources' on Instance uuid 60ae3077-6475-4d3c-aa10-a239f7cd854f {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1872760598',display_name='tempest-TestMinimumBasicScenario-server-1872760598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1872760598',id=51,image_ref='f1c06d1f-0144-462f-877e-74c289442d59',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOF72Ghmmq2yu2Kn1NDJz1Xj6R0ZMBin+XEtXQyviA9D+B+H9rClKJZB8G8Usar49py+C7jQXIj8MFyiCy/6BenolCG7NpSgnD7913ARAnIpXhEVK3iSJzqpCFraetEkw==',key_name='tempest-TestMinimumBasicScenario-2024502536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-vd0fliuw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c06d1f-0144-462f-877e-74c289442d59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:25:07Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=60ae3077-6475-4d3c-aa10-a239f7cd854f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "a54ad634-6e9e-446e-9118-75e5724d662f", "address": "fa:16:3e:0d:45:44", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa54ad634-6e", "ovs_interfaceid": "a54ad634-6e9e-446e-9118-75e5724d662f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG os_vif [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa54ad634-6e, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2e6cb94-e161-412a-9116-79a7112e2c5e) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:27:55 user nova-compute[87365]: INFO os_vif [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:45:44,bridge_name='br-int',has_traffic_filtering=True,id=a54ad634-6e9e-446e-9118-75e5724d662f,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa54ad634-6e')
Nov 08 14:27:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Deleting instance files /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f_del
Nov 08 14:27:55 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Deletion of /opt/stack/data/nova/instances/60ae3077-6475-4d3c-aa10-a239f7cd854f_del complete
Nov 08 14:27:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:27:55 user nova-compute[87365]: INFO nova.compute.manager [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 14:27:55 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:27:55 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:27:55 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Took 0.49 seconds to deallocate network for instance.
Nov 08 14:27:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-64b11801-7ff1-47a0-b288-aca60bde9d83 req-639da99b-03e5-4074-a0bf-379115e29d96 service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-deleted-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:27:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:56 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:27:56 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:27:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:56 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Deleted allocations for instance 60ae3077-6475-4d3c-aa10-a239f7cd854f
Nov 08 14:27:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4f280c39-081a-4c1d-8546-327fa13476e8 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:27:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] Acquiring lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:27:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:27:57 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] Lock "60ae3077-6475-4d3c-aa10-a239f7cd854f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:27:57 user nova-compute[87365]: DEBUG nova.compute.manager [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] No waiting events found dispatching network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:27:57 user nova-compute[87365]: WARNING nova.compute.manager [req-af9fc9a3-5101-4bf8-b746-e98994552a4a req-6165d139-e38d-44aa-a71b-3335a1992d8f service nova] [instance: 60ae3077-6475-4d3c-aa10-a239f7cd854f] Received unexpected event network-vif-plugged-a54ad634-6e9e-446e-9118-75e5724d662f for instance with vm_state deleted and task_state None.
Nov 08 14:27:58 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:01 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:28:03 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:03 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:03 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:28:04 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:28:04 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.294273376464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:28:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:28:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:28:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:28:13 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:28:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Starting instance... {{(pid=87365) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=87365) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 14:28:49 user nova-compute[87365]: INFO nova.compute.claims [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Claim successful on node user
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Start building networks asynchronously for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Allocating IP information in the background. {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] allocate_for_instance() {{(pid=87365) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 14:28:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Start building block device mappings for instance. {{(pid=87365) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.policy [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c6a7ff5fa944500b1efad8434a43207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6a867401c844ee8dab7695f9e6a44b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87365) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Start spawning the instance on the hypervisor. {{(pid=87365) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Creating instance directory {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 14:28:49 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Creating image(s)
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "/opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "/opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "/opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:49 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.part --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Successfully created port: 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.part --force-share --output=json" returned: 0 in 0.210s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG nova.virt.images [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6 was qcow2, converting to raw {{(pid=87365) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG nova.privsep.utils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=87365) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.part /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.converted {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:50 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.part /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.converted" returned: 0 in 0.460s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.converted --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.319s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Successfully updated port: 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.compute.manager [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing instance network info cache due to event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance cache missing network info. {{(pid=87365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json" returned: 0 in 0.185s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json" returned: 0 in 0.190s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662,backing_fmt=raw /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk 1073741824 {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662,backing_fmt=raw /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk 1073741824" returned: 0 in 0.060s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "9d6b83a033bc02b9eb73c8fab9c7be63a8820662" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.network.neutron [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance network_info: |[{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=87365) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:28:51 user nova-compute[87365]: DEBUG nova.network.neutron [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d6b83a033bc02b9eb73c8fab9c7be63a8820662 --force-share --output=json" returned: 0 in 0.281s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk. size=1073741824 {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.disk.api [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Cannot resize image /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk to a smaller size. {{(pid=87365) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Created local disks {{(pid=87365) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Ensure instance console log exists: /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/console.log {{(pid=87365) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Start _get_guest_xml network_info=[{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T14:28:46Z,direct_url=<?>,disk_format='qcow2',id=eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6,min_disk=0,min_ram=0,name='tempest-scenario-img--1912407104',owner='4c6a867401c844ee8dab7695f9e6a44b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T14:28:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'encryption_options': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 14:28:52 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:28:52 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller missing on host. {{(pid=87365) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.host [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU controller found on host. {{(pid=87365) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=87365) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T13:39:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T14:28:46Z,direct_url=<?>,disk_format='qcow2',id=eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6,min_disk=0,min_ram=0,name='tempest-scenario-img--1912407104',owner='4c6a867401c844ee8dab7695f9e6a44b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T14:28:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image limits 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flavor pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Image pref 0:0:0 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Got 1 possible topologies {{(pid=87365) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.hardware [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=87365) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1854763459',display_name='tempest-TestMinimumBasicScenario-server-1854763459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1854763459',id=52,image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEX4HWDVeNwOcVetjDYUe8IuTEZdntPu6z2J1EPcRM9gtSBUnjAbgzbOfSVD5KtXSnO8gsJZpg41YigpUpVSXNFWhShhK0U5t4fgZyKun8d6HGLeZpIUqzECo0mhTW9nA==',key_name='tempest-TestMinimumBasicScenario-1155105125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-op4nnni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:28:50Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=834e0b1d-1fae-4356-99af-cceb64f920d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=87365) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.objects.instance [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'pci_devices' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 14:28:52 user nova-compute[87365]:   <uuid>834e0b1d-1fae-4356-99af-cceb64f920d8</uuid>
Nov 08 14:28:52 user nova-compute[87365]:   <name>instance-00000034</name>
Nov 08 14:28:52 user nova-compute[87365]:   <memory>524288</memory>
Nov 08 14:28:52 user nova-compute[87365]:   <vcpu>1</vcpu>
Nov 08 14:28:52 user nova-compute[87365]:   <metadata>
Nov 08 14:28:52 user nova-compute[87365]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 14:28:52 user nova-compute[87365]:       <nova:package version="0.0.0"/>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:name>tempest-TestMinimumBasicScenario-server-1854763459</nova:name>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:creationTime>2023-11-08 14:28:52</nova:creationTime>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:flavor name="m1.tiny">
Nov 08 14:28:52 user nova-compute[87365]:         <nova:memory>512</nova:memory>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:disk>1</nova:disk>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:swap>0</nova:swap>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:vcpus>1</nova:vcpus>
Nov 08 14:28:52 user nova-compute[87365]:       </nova:flavor>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:owner>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:user uuid="1c6a7ff5fa944500b1efad8434a43207">tempest-TestMinimumBasicScenario-1047379247-project-member</nova:user>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:project uuid="4c6a867401c844ee8dab7695f9e6a44b">tempest-TestMinimumBasicScenario-1047379247</nova:project>
Nov 08 14:28:52 user nova-compute[87365]:       </nova:owner>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:root type="image" uuid="eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6"/>
Nov 08 14:28:52 user nova-compute[87365]:       <nova:ports>
Nov 08 14:28:52 user nova-compute[87365]:         <nova:port uuid="4723a23b-7c4a-4bdd-8920-43277e45f590">
Nov 08 14:28:52 user nova-compute[87365]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 14:28:52 user nova-compute[87365]:         </nova:port>
Nov 08 14:28:52 user nova-compute[87365]:       </nova:ports>
Nov 08 14:28:52 user nova-compute[87365]:     </nova:instance>
Nov 08 14:28:52 user nova-compute[87365]:   </metadata>
Nov 08 14:28:52 user nova-compute[87365]:   <sysinfo type="smbios">
Nov 08 14:28:52 user nova-compute[87365]:     <system>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="product">OpenStack Nova</entry>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="version">0.0.0</entry>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="serial">834e0b1d-1fae-4356-99af-cceb64f920d8</entry>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="uuid">834e0b1d-1fae-4356-99af-cceb64f920d8</entry>
Nov 08 14:28:52 user nova-compute[87365]:       <entry name="family">Virtual Machine</entry>
Nov 08 14:28:52 user nova-compute[87365]:     </system>
Nov 08 14:28:52 user nova-compute[87365]:   </sysinfo>
Nov 08 14:28:52 user nova-compute[87365]:   <os>
Nov 08 14:28:52 user nova-compute[87365]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 14:28:52 user nova-compute[87365]:     <boot dev="hd"/>
Nov 08 14:28:52 user nova-compute[87365]:     <smbios mode="sysinfo"/>
Nov 08 14:28:52 user nova-compute[87365]:   </os>
Nov 08 14:28:52 user nova-compute[87365]:   <features>
Nov 08 14:28:52 user nova-compute[87365]:     <acpi/>
Nov 08 14:28:52 user nova-compute[87365]:     <apic/>
Nov 08 14:28:52 user nova-compute[87365]:     <vmcoreinfo/>
Nov 08 14:28:52 user nova-compute[87365]:   </features>
Nov 08 14:28:52 user nova-compute[87365]:   <clock offset="utc">
Nov 08 14:28:52 user nova-compute[87365]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 14:28:52 user nova-compute[87365]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 14:28:52 user nova-compute[87365]:     <timer name="hpet" present="no"/>
Nov 08 14:28:52 user nova-compute[87365]:   </clock>
Nov 08 14:28:52 user nova-compute[87365]:   <cpu mode="custom" match="exact">
Nov 08 14:28:52 user nova-compute[87365]:     <model>Nehalem</model>
Nov 08 14:28:52 user nova-compute[87365]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 14:28:52 user nova-compute[87365]:   </cpu>
Nov 08 14:28:52 user nova-compute[87365]:   <devices>
Nov 08 14:28:52 user nova-compute[87365]:     <disk type="file" device="disk">
Nov 08 14:28:52 user nova-compute[87365]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 14:28:52 user nova-compute[87365]:       <source file="/opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk"/>
Nov 08 14:28:52 user nova-compute[87365]:       <target dev="vda" bus="virtio"/>
Nov 08 14:28:52 user nova-compute[87365]:     </disk>
Nov 08 14:28:52 user nova-compute[87365]:     <interface type="ethernet">
Nov 08 14:28:52 user nova-compute[87365]:       <mac address="fa:16:3e:39:4e:59"/>
Nov 08 14:28:52 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:28:52 user nova-compute[87365]:       <mtu size="1442"/>
Nov 08 14:28:52 user nova-compute[87365]:       <target dev="tap4723a23b-7c"/>
Nov 08 14:28:52 user nova-compute[87365]:     </interface>
Nov 08 14:28:52 user nova-compute[87365]:     <serial type="pty">
Nov 08 14:28:52 user nova-compute[87365]:       <log file="/opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/console.log" append="off"/>
Nov 08 14:28:52 user nova-compute[87365]:     </serial>
Nov 08 14:28:52 user nova-compute[87365]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 14:28:52 user nova-compute[87365]:     <video>
Nov 08 14:28:52 user nova-compute[87365]:       <model type="virtio"/>
Nov 08 14:28:52 user nova-compute[87365]:     </video>
Nov 08 14:28:52 user nova-compute[87365]:     <rng model="virtio">
Nov 08 14:28:52 user nova-compute[87365]:       <backend model="random">/dev/urandom</backend>
Nov 08 14:28:52 user nova-compute[87365]:     </rng>
Nov 08 14:28:52 user nova-compute[87365]:     <controller type="usb" index="0" model="none"/>
Nov 08 14:28:52 user nova-compute[87365]:     <memballoon model="virtio">
Nov 08 14:28:52 user nova-compute[87365]:       <stats period="10"/>
Nov 08 14:28:52 user nova-compute[87365]:     </memballoon>
Nov 08 14:28:52 user nova-compute[87365]:   </devices>
Nov 08 14:28:52 user nova-compute[87365]: </domain>
Nov 08 14:28:52 user nova-compute[87365]:  {{(pid=87365) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1854763459',display_name='tempest-TestMinimumBasicScenario-server-1854763459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1854763459',id=52,image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEX4HWDVeNwOcVetjDYUe8IuTEZdntPu6z2J1EPcRM9gtSBUnjAbgzbOfSVD5KtXSnO8gsJZpg41YigpUpVSXNFWhShhK0U5t4fgZyKun8d6HGLeZpIUqzECo0mhTW9nA==',key_name='tempest-TestMinimumBasicScenario-1155105125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-op4nnni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T14:28:50Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=834e0b1d-1fae-4356-99af-cceb64f920d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG os_vif [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c') {{(pid=87365) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1be5d879-c03b-5548-99a4-0dbdfde1e485', '_type': 'linux-noop'}}, row=False) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4723a23b-7c, may_exist=True, interface_attrs={}) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4723a23b-7c, col_values=(('qos', UUID('38a51ea3-3ecd-4f46-8b10-a8127a7dafaf')),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4723a23b-7c, col_values=(('external_ids', {'iface-id': '4723a23b-7c4a-4bdd-8920-43277e45f590', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:4e:59', 'vm-uuid': '834e0b1d-1fae-4356-99af-cceb64f920d8'}),), if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:52 user nova-compute[87365]: INFO os_vif [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c')
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No VIF found with MAC fa:16:3e:39:4e:59, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated VIF entry in instance network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG nova.network.neutron [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:28:52 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5f641508-9a11-44ac-8d38-9b8e9ed9aaa7 req-b95e8d76-ced5-4145-9eaf-806137a86fd0 service nova] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:53 user nova-compute[87365]: DEBUG nova.compute.manager [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:28:53 user nova-compute[87365]: WARNING nova.compute.manager [req-301a6b80-41e8-4d6b-9ecc-474303943141 req-5ce4d1f4-069d-436f-97e2-6349928a075a service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state building and task_state spawning.
Nov 08 14:28:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:54 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.compute.manager [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:28:56 user nova-compute[87365]: WARNING nova.compute.manager [req-3a403814-c33d-4ed3-8240-962beb78b728 req-04267e51-a8bc-45ed-bec9-5d636bef333d service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state building and task_state spawning.
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance event wait completed in 0 seconds for  {{(pid=87365) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Guest created on hypervisor {{(pid=87365) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 14:28:56 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance spawned successfully.
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_cdrom_bus of ide {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_disk_bus of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_input_bus of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_pointer_model of None {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_video_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Found default for hw_vif_model of virtio {{(pid=87365) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 14:28:56 user nova-compute[87365]: INFO nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 08 14:28:56 user nova-compute[87365]: DEBUG nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:28:56 user nova-compute[87365]: INFO nova.compute.manager [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Took 6.78 seconds to build instance.
Nov 08 14:28:56 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-98238558-3c2a-489c-ab40-e64a93747f3d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.886s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:28:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:28:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:03 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:03 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:03 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:29:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:29:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:29:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.263187408447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:29:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:29:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:29:12 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:29:13 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:29:13 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:29:13 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:29:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:52 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:29:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:29:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:00 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:30:04 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:30:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:30:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.233745574951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:30:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:30:06 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:06 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:06 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:30:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:13 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:30:14 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:30:15 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:30:15 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:30:15 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:30:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 5 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:30:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:28 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:30:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:30:45 user nova-compute[87365]: DEBUG nova.objects.instance [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:30:45 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:30:46 user nova-compute[87365]: INFO nova.compute.manager [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Attaching volume 1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 to /dev/vdb
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.utils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[8041f991-704c-486a-9dcf-8f2ae0864ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2dffd3d854ca\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9f50f-2dcf-4a43-bea9-0f0b50d6eb0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1cb30-cb57-4fba-b1f6-6667e0427179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ce349-72c3-4872-b05b-e0a8a8d18946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Running cmd (subprocess): nvme version {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] 'nvme version' failed. Not Retrying. {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] nvme not present on system {{(pid=87365) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 14:30:46 user nova-compute[87365]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 14:30:46 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[680dcb83-6371-4ea9-ab92-9eff49911378]: (4, '') {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=87365) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.lightos [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] LIGHTOS: no hostnqn found. {{(pid=87365) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG os_brick.utils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2dffd3d854ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:30:46 user nova-compute[87365]: DEBUG nova.virt.block_device [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating existing volume attachment record: c4c8e655-02b8-4087-8470-66acd4844364 {{(pid=87365) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 14:30:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:30:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:30:54 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:30:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:31:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=24.232791900634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:31:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:08 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:08 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:31:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:31:16 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Calling os-brick to attach iSCSI Volume {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKougRUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:31:17 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:31:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:31:17 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:31:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:31:17 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:31:17 user nova-compute[87365]: INFO os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 14:31:17 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cec6a0a-fa7b-4f4f-87d6-6f45b4c5c6d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 14:31:18 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d712b6-c81d-479a-a531-88e40ca19919]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0] added\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0] added
Nov 08 14:31:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a56ef-b9f9-4583-8ddd-93e770a38d50]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ef98c-7249-46fb-ac0a-9b66ac3f4194]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKougRUX {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKougRUX" returned: 0 in 0.026s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b4f09-4b90-4bcd-97a1-7d52999f4400]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKougRUX'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94175e1-9181-4a5c-b884-1d7e67d9a714]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e12fa3-f54d-4eb2-8345-80e1fa5d2b9b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:31:18 user nova-compute[87365]:  {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 14:31:18 user nova-compute[87365]:  {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:31:18 user nova-compute[87365]: WARNING os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 14:31:18 user nova-compute[87365]: 
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --login {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[071dbb0c-e3b4-4d11-83fd-ac57a65b6b93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260]
Nov 08 14:31:18 user nova-compute[87365]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260] successful.
Nov 08 14:31:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[4469f79a-81ea-442b-ae19-b15abae40b69]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccee4e5-f847-40db-8999-3812fa5317f2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)
Nov 08 14:31:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)
Nov 08 14:31:18 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to 172.16.0.220:3260 {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=87365) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=87365) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9577a-8439-4f55-8fda-9d09f7471654]: (4, ('- - 0', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=87365) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 14:31:18 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKougRUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=87365) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23638616232613262', 'path': '/dev/sdb'} {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638616232613262', 'path': '/dev/sdb'} {{(pid=87365) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.objects.instance [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 14:31:19 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:31:19 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:31:19 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:31:19 user nova-compute[87365]:   <serial>1e8fdb01-80fe-47e6-ab05-e14ba50b20b0</serial>
Nov 08 14:31:19 user nova-compute[87365]: </disk>
Nov 08 14:31:19 user nova-compute[87365]:  {{(pid=87365) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vda, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=87365) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] No VIF found with MAC fa:16:3e:39:4e:59, not building metadata {{(pid=87365) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 14:31:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-70dc2247-2404-4cd9-88ae-2cb55008e2cd tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.797s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:21 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing instance network info cache due to event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated VIF entry in instance network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG nova.network.neutron [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:31:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-cf11afd7-1858-4019-a926-f63d87e78a7f req-6cab497d-2f0e-4701-863b-9b817792efc8 service nova] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.compute.manager [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing instance network info cache due to event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:25 user nova-compute[87365]: INFO nova.compute.manager [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Rebooting instance
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated VIF entry in instance network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.network.neutron [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-ae37a0c3-8975-46d7-b188-2eae12c7157c req-de3be5cd-1c26-4b33-bca9-fc8b0a7f7b76 service nova] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Building network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.network.neutron [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:31:25 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:28 user nova-compute[87365]: DEBUG nova.compute.manager [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:31:28 user nova-compute[87365]: WARNING nova.compute.manager [req-2066b917-782d-4ec9-86a4-a7205a222d88 req-c902b02f-890f-4444-9f98-9ac8864e73a6 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state active and task_state reboot_started.
Nov 08 14:31:29 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance shutdown successfully.
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG nova.compute.manager [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:31:30 user nova-compute[87365]: WARNING nova.compute.manager [req-5244d240-e3ba-44f5-a3db-861561d9b32e req-c63973a7-8281-4ca8-a7c6-41962a595acd service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state active and task_state reboot_started.
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance running successfully.
Nov 08 14:31:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:31:32 user nova-compute[87365]: WARNING nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state active and task_state reboot_started.
Nov 08 14:31:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:31:32 user nova-compute[87365]: WARNING nova.compute.manager [req-c99d170d-8434-4513-b174-8c8151d60a00 req-e76e13fd-4ac4-40cd-a908-05bf2fb3e8bc service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state active and task_state reboot_started.
Nov 08 14:31:32 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance soft rebooted successfully.
Nov 08 14:31:32 user nova-compute[87365]: DEBUG nova.compute.manager [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Checking state {{(pid=87365) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-9f78d9ea-a8f5-4def-9bca-0c97b47d4c52 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.212s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:34 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_power_states {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:34 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Triggering sync for uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 14:31:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:31:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:31:34 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:31:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:56 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:31:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:31:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:32:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:32:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:32:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=24.230899810791016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:32:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:32:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:09 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:32:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:32:17 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:32:18 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:32:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:32:18 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:32:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:32:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:32:57 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=87365) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 14:33:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:33:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=24.230369567871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:33:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:33:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:33:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:12 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG nova.compute.manager [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing instance network info cache due to event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG nova.network.neutron [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated VIF entry in instance network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-b1f1dfb6-77f0-4466-a008-601c1e5a9753 req-a5f54fb3-ffee-4dfc-a163-9a09235745b3 service nova] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.compute.manager [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing instance network info cache due to event network-changed-4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Refreshing network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:33:18 user nova-compute[87365]: INFO nova.compute.manager [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Detaching volume 1e8fdb01-80fe-47e6-ab05-e14ba50b20b0
Nov 08 14:33:18 user nova-compute[87365]: INFO nova.virt.block_device [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Attempting to driver detach volume 1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 from mountpoint /dev/vdb
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Attempting to detach device vdb from instance 834e0b1d-1fae-4356-99af-cceb64f920d8 from the persistent domain config. {{(pid=87365) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:33:18 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:33:18 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:33:18 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:33:18 user nova-compute[87365]:   <serial>1e8fdb01-80fe-47e6-ab05-e14ba50b20b0</serial>
Nov 08 14:33:18 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:33:18 user nova-compute[87365]: </disk>
Nov 08 14:33:18 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:33:18 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully detached device vdb from instance 834e0b1d-1fae-4356-99af-cceb64f920d8 from the persistent domain config.
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 834e0b1d-1fae-4356-99af-cceb64f920d8 from the live domain config. {{(pid=87365) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.virt.libvirt.guest [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 14:33:18 user nova-compute[87365]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 14:33:18 user nova-compute[87365]:   <source dev="/dev/sdb"/>
Nov 08 14:33:18 user nova-compute[87365]:   <target dev="vdb" bus="virtio"/>
Nov 08 14:33:18 user nova-compute[87365]:   <serial>1e8fdb01-80fe-47e6-ab05-e14ba50b20b0</serial>
Nov 08 14:33:18 user nova-compute[87365]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 14:33:18 user nova-compute[87365]: </disk>
Nov 08 14:33:18 user nova-compute[87365]:  {{(pid=87365) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated VIF entry in instance network info cache for port 4723a23b-7c4a-4bdd-8920-43277e45f590. {{(pid=87365) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG nova.network.neutron [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:33:18 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-a6d40128-f07d-46b1-a2cd-c24ef98ea939 req-ad40be00-f92a-4992-bcfa-cd0c4942b6b3 service nova] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquired lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Forcefully refreshing network info cache for instance {{(pid=87365) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 14:33:19 user nova-compute[87365]: DEBUG nova.objects.instance [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lazy-loading 'info_cache' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:33:20 user nova-compute[87365]: DEBUG nova.network.neutron [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [{"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:33:20 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Releasing lock "refresh_cache-834e0b1d-1fae-4356-99af-cceb64f920d8" {{(pid=87365) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 14:33:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updated the network info_cache for instance {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 14:33:22 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:27 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:32 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:37 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:39 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 834e0b1d-1fae-4356-99af-cceb64f920d8 is timed out.
Nov 08 14:33:39 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully detached device vdb from instance 834e0b1d-1fae-4356-99af-cceb64f920d8 from the live domain config.
Nov 08 14:33:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] calling os-brick to detach iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3d181e5f30>, {'target_iqn': 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKougRUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 14:33:39 user nova-compute[87365]: WARNING os_brick.initiator.connectors.base [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3cc0e7-20c9-4dcd-a8c5-e4446098d6f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 14:33:39 user nova-compute[87365]: No targets found.
Nov 08 14:33:39 user nova-compute[87365]: iSNS:
Nov 08 14:33:39 user nova-compute[87365]: No targets found.
Nov 08 14:33:39 user nova-compute[87365]: STATIC:
Nov 08 14:33:39 user nova-compute[87365]: Target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0
Nov 08 14:33:39 user nova-compute[87365]:         Portal: 172.16.0.220:3260,-1
Nov 08 14:33:39 user nova-compute[87365]:                 Iface Name: default
Nov 08 14:33:39 user nova-compute[87365]: FIRMWARE:
Nov 08 14:33:39 user nova-compute[87365]: No targets found.
Nov 08 14:33:39 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 14:33:39 user nova-compute[87365]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 14:33:39 user nova-compute[87365]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=87365) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0', 0)] {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0250b1-86c8-455d-931a-bff1c2f85bef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0783721-b42d-4c20-a440-31f0d88d5acf]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)
Nov 08 14:33:39 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 (non-flash)
Nov 08 14:33:39 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3cd4fd56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0'): ({'sdb'}, set())}) {{(pid=87365) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Removing single pathed devices sdb {{(pid=87365) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ae6ea3-e93e-4896-9d0e-0c2c32b25d6a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad575ff8-a02c-4588-b142-7b270affdea8]: (4, ('ok\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Flushing IO for device /dev/sdb {{(pid=87365) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9fa615-7fb1-4442-96ba-79ec919bd3c8]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=87365) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c2879-94ac-4400-ab37-06de0ff9027d]: (4, ('1', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.linuxscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] SCSI volumes sdb have been removed. {{(pid=87365) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0')] {{(pid=87365) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad96e12-a4a7-4060-8e4e-e1cdc533f82d]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --logout {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e90bf3-5c73-4e51-8d6c-dd1397303ec6]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260]
Nov 08 14:33:39 user nova-compute[87365]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0, portal: 172.16.0.220,3260] successful.
Nov 08 14:33:39 user nova-compute[87365]:  stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op delete {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e8fdb01-80fe-47e6-ab05-e14ba50b20b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=99274) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2e000-89cf-4306-987b-7fafb59b3c97]: (4, ('', '')) {{(pid=99274) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=87365) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.base [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] <== disconnect_volume: return (290ms) None {{(pid=87365) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 14:33:39 user nova-compute[87365]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Disconnected iSCSI Volume {{(pid=87365) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 14:33:40 user nova-compute[87365]: DEBUG nova.objects.instance [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'flavor' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:33:40 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-4aa3abad-4105-4d13-a8ba-018680d33e7d tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:42 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:47 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:33:52 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:33:57 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:33:59 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:02 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:34:05 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG oslo_concurrency.processutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=87365) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 14:34:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:34:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.229583740234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Instance 834e0b1d-1fae-4356-99af-cceb64f920d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=87365) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:34:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:07 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:10 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:10 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:34:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:14 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:17 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:19 user nova-compute[87365]: INFO nova.compute.manager [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Terminating instance
Nov 08 14:34:19 user nova-compute[87365]: DEBUG nova.compute.manager [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Start destroying the instance on the hypervisor. {{(pid=87365) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:34:19 user nova-compute[87365]: DEBUG nova.compute.manager [req-db6c4410-fcee-42d7-ad1d-97eb617b4f34 req-a354daf0-b332-42ba-aa56-a6fa2ffd019f service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-unplugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with task_state deleting. {{(pid=87365) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:20 user nova-compute[87365]: INFO nova.virt.libvirt.driver [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Instance destroyed successfully.
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.objects.instance [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lazy-loading 'resources' on Instance uuid 834e0b1d-1fae-4356-99af-cceb64f920d8 {{(pid=87365) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.virt.libvirt.vif [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T14:28:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1854763459',display_name='tempest-TestMinimumBasicScenario-server-1854763459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1854763459',id=52,image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEX4HWDVeNwOcVetjDYUe8IuTEZdntPu6z2J1EPcRM9gtSBUnjAbgzbOfSVD5KtXSnO8gsJZpg41YigpUpVSXNFWhShhK0U5t4fgZyKun8d6HGLeZpIUqzECo0mhTW9nA==',key_name='tempest-TestMinimumBasicScenario-1155105125',keypairs=<?>,launch_index=0,launched_at=2023-11-08T14:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6a867401c844ee8dab7695f9e6a44b',ramdisk_id='',reservation_id='r-op4nnni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eeb1a582-a81f-42dc-9c5f-c6c825b7fbf6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1047379247',owner_user_name='tempest-TestMinimumBasicScenario-1047379247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T14:31:33Z,user_data=None,user_id='1c6a7ff5fa944500b1efad8434a43207',uuid=834e0b1d-1fae-4356-99af-cceb64f920d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converting VIF {"id": "4723a23b-7c4a-4bdd-8920-43277e45f590", "address": "fa:16:3e:39:4e:59", "network": {"id": "b17fefdf-90c7-49ed-9766-eb9e820e47e3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-642485119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6a867401c844ee8dab7695f9e6a44b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4723a23b-7c", "ovs_interfaceid": "4723a23b-7c4a-4bdd-8920-43277e45f590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.network.os_vif_util [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c') {{(pid=87365) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG os_vif [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c') {{(pid=87365) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4723a23b-7c, bridge=br-int, if_exists=True) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38a51ea3-3ecd-4f46-8b10-a8127a7dafaf) {{(pid=87365) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:20 user nova-compute[87365]: INFO os_vif [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:4e:59,bridge_name='br-int',has_traffic_filtering=True,id=4723a23b-7c4a-4bdd-8920-43277e45f590,network=Network(b17fefdf-90c7-49ed-9766-eb9e820e47e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4723a23b-7c')
Nov 08 14:34:20 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Deleting instance files /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8_del
Nov 08 14:34:20 user nova-compute[87365]: INFO nova.virt.libvirt.driver [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Deletion of /opt/stack/data/nova/instances/834e0b1d-1fae-4356-99af-cceb64f920d8_del complete
Nov 08 14:34:20 user nova-compute[87365]: INFO nova.compute.manager [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 14:34:20 user nova-compute[87365]: DEBUG oslo.service.loopingcall [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=87365) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.compute.manager [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Deallocating network for instance {{(pid=87365) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] deallocate_for_instance() {{(pid=87365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Skipping network cache update for instance because it is being deleted. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 08 14:34:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG nova.network.neutron [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Updating instance_info_cache with network_info: [] {{(pid=87365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 14:34:21 user nova-compute[87365]: INFO nova.compute.manager [-] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Took 0.58 seconds to deallocate network for instance.
Nov 08 14:34:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG nova.compute.manager [req-b97fc250-5895-4fdf-9b98-9f20a4dfd53b req-e182fa5e-4b31-431d-a110-d0d5f5c280da service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-deleted-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:34:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:21 user nova-compute[87365]: INFO nova.scheduler.client.report [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Deleted allocations for instance 834e0b1d-1fae-4356-99af-cceb64f920d8
Nov 08 14:34:21 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-51707988-902e-4a8e-af20-74c1b1aab467 tempest-TestMinimumBasicScenario-1047379247 tempest-TestMinimumBasicScenario-1047379247-project-member] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 14:34:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] Acquiring lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:34:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:34:22 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] Lock "834e0b1d-1fae-4356-99af-cceb64f920d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:34:22 user nova-compute[87365]: DEBUG nova.compute.manager [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] No waiting events found dispatching network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 {{(pid=87365) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 14:34:22 user nova-compute[87365]: WARNING nova.compute.manager [req-89b02daf-9a75-41a1-b321-4f35e3023461 req-4a2679a2-13af-4196-ac95-91510422fd02 service nova] [instance: 834e0b1d-1fae-4356-99af-cceb64f920d8] Received unexpected event network-vif-plugged-4723a23b-7c4a-4bdd-8920-43277e45f590 for instance with vm_state deleted and task_state None.
Nov 08 14:34:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:34:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:34:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:35:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:35:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:35:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:35:06 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.25690460205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:35:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:35:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:11 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:35:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:12 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:13 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:14 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:20 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:35:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:35:20 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:35:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:35:26 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 14:35:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] There are 1 instances to clean {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 14:35:26 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] [instance: de510f72-fe85-4b4f-8938-ca8976aaff02] Instance has had 5 of 5 cleanup attempts {{(pid=87365) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Nov 08 14:35:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:31 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:35:31 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Cleaning up deleted instances with incomplete migration  {{(pid=87365) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 14:35:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:35:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:01 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:04 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:36:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:36:05 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:36:05 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=24.29507827758789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:36:05 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:36:06 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:36:07 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:11 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:12 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:12 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:36:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:16 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=87365) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=87365) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 14:36:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:21 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Starting heal instance info cache {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 14:36:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Rebuilding the list of instances to heal {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 14:36:21 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Didn't find any instances for network info cache update. {{(pid=87365) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 14:36:25 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:30 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:35 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:36 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:36:40 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:45 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:50 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:36:55 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:36:56 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:37:00 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:37:02 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:05 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:37:05 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:07 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager.update_available_resource {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:37:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:37:07 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:37:07 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Auditing locally available compute resources for user (node: user) {{(pid=87365) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 14:37:08 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:37:08 user nova-compute[87365]: WARNING nova.virt.libvirt.driver [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=24.272689819335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=87365) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=87365) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing inventories for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating ProviderTree inventory for provider 3e23700a-4955-415f-80cb-af3ae211a65e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Updating inventory in ProviderTree for provider 3e23700a-4955-415f-80cb-af3ae211a65e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing aggregate associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, aggregates: None {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Refreshing trait associations for resource provider 3e23700a-4955-415f-80cb-af3ae211a65e, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSSE3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=87365) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.provider_tree [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed in ProviderTree for provider: 3e23700a-4955-415f-80cb-af3ae211a65e {{(pid=87365) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.scheduler.client.report [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Inventory has not changed for provider 3e23700a-4955-415f-80cb-af3ae211a65e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=87365) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG nova.compute.resource_tracker [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Compute_service record updated for user:user {{(pid=87365) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 14:37:08 user nova-compute[87365]: DEBUG oslo_concurrency.lockutils [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=87365) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 14:37:09 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:10 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 14:37:12 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:14 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:14 user nova-compute[87365]: DEBUG nova.compute.manager [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=87365) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 14:37:15 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 14:37:17 user nova-compute[87365]: DEBUG oslo_service.periodic_task [None req-26507972-93d1-4e4b-aa74-6bc4ca6b4034 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=87365) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 14:37:20 user nova-compute[87365]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=87365) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}